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FOREWORD 


Tue Navy that fought in World War II was the most technical and 
highly organized of any navy in history. The combat success of a 
fleet, task force, or unit depended in large part on the individual 
skill of the officers and men manning battle stations and on their 
ability to work as a team. This success, in the many complex opera- 
tions, was in no small measure due to the fact that personnel had 
been placed in jobs for which they had aptitude and for which they 
had been trained. Modern selection, classification, and training 
methods were an essential factor in solving the Navy’s tremendous 
manpower problem in World War II. 

The tests and research studies reported in this book are the major 
personnel research activities conducted by the Bureau of Naval 
Personnel with the assistance of the National Defense Research Com- 
mittee Project N-106 and the College Entrance Examination Board. 
The writers of the chapters have not only described the results of 
past work but have called attention to some of the many personnel 
problems still confronting the Navy. The findings presented in this 
publication are valuable not only for the immediately useful data 
they provide but even more for their stimulation of future research. 

Many of the officers and civilian personnel who have contributed 
to this work have returned to their peacetime pursuits. The Bureau 
of Naval Personnel appreciates their contribution in increasing the 
efficiency of its program and in laying the ground work for study, 
research, and development in the years that lie ahead. 


W. С. COOPER 
Captain, U.S.N. 
Director 
Research Activity 


PREFACE 


Tus book is intended primarily for personnel psychologists in mili- 
tary organizations, educational institutions, public personnel adminis- 
tration, business, and industry. While few distinctly new techniques 
are presented, there is given an account of the experience of one 
military personnel research organization with the application of 
established techniques to the varied problems of military selection, 
classification, and training. This experience should be of value to 
students of personnel psychology and to individuals responsible for 
planning personnal research programs. 

The purpose of this book is to present an evaluative summary of 
the personnel research and test development completed during 
World War II by the Test and Research Section of the Bureau of 
Naval Personnel in cooperation with the National Defense Research 
Committee Project N-106 and the College Entrance Examination 
Board. Since the Test and Research Section and the latter organiza- 
tions worked cooperatively on many projects, there is no attempt 
made here to identify the specific accomplishments of each. 

Part I presents a history of personnel research and test develop- 
ment in the Bureau of Naval Personnel and a brief account of the 
Bureau’s selection, classification and training programs. These chap- 
ters are intended to give the reader the necessary background for the 
chapters which follow; by first reading these, the reader will be ina 
better position to see how tests, technical personnel aids, and the 
results of research were put to administrative use. As pointed out 
in Chapter I, the Test and Research Section is а rese 
tion and as such does not have administrative control 
classification, or training programs. 

Part II describes the construction of the selection and classification 
instruments developed for use by the Bureau of Naval Personnel. 
The Basic Test Battery administered to over 2,000,000 recruits and 
the Officer Qualification and Officer Classification Tests admin- 
istered to over 100,000 officers are described in this part. The re- 
search on the construction and validation of measures of personal 
adjustment is also included in this part. 

Part III is concerned with the prediction of success in Navy 
training programs. The selection of individuals for various types of 
schools was a major personnel problem both on the officer and en- 
listed level. While it would have been highly desirable to correlate 
test scores and other qualifications data of individuals with success 


on the job, most of the Bureau's validation studies u 
ix 


arch organiza- 
Over selection, 


sed as criteria 


х Preface 


of success grades received in school. On the basis of these prediction 
studies, selection requirements were formulated or revised. 

Part IV describes the development and use of achievement tests 
in Navy training programs. The emphasis in this part is on the effect 
that standardized achievement tests have had on the quality of Navy 
instruction and the administration of schools. No attempt is made 
to give a description of all the achievement tests which were de- 
veloped or of the studies made involving the use of achievement tests. 

Follow-up studies and plans for future research are included in 
Part V. Since the nature of the criterion is one of the most important 
aspects of a follow-up study, the first chapter is devoted to a discus- 
sion of this subject. The data presented in Chapter XX are unique 
in that they constitute the results of the first systematic study under- 
taken by the Navy on the relationship between the background 
factors of enlisted personnel and performance aboard ship. Chapter 
XXI describes the first systematic studies sponsored by the Navy to 
obtain reactions of personnel to the Navy's classification and training 
programs. 'The purpose of the final chapter is to discuss briefly some 
of the classification and training problems which still remain in the 
Navy. 

The terms qualification, selection, and classification are used fre- 
quently in this book. During the early part of the war the term 
qualification was generally applied to determining whether an indi- 
vidual was suitable for the naval service; selection was applied t? 
picking candidates for school training; determining qualifications 
for duty was termed classification. With the passage of time, the 
process of determining qualifications for both training and billet 
assignments was termed classification and there was an inclination 
to use the terms qualification and selection interchangeably. Because 
of their varied use, there is no attempt made in this book to attach 
precise meaning to the terms, although the preference of the authors 
is to apply the term selection to determining qualification for the 
naval service and classification to determining qualifications for 
training and billet assignments. 

The materials presented in this publication do not constitute ? 
complete account of the work of either the Test and Research Sec 
tion or of the NDRC Project N-106 and the College Entrance 
Examination Board; but there is given in the appendix a complete 
list of the tests produced or officially approved by the Test and 
Research Section, a list of research studies completed by the Section, 
and those reports of NDRC Project N-106 which constituted source 
material for research discussed in this volume. Experimental tests 
and informal research reports have been omitted from these lists- 
Tests and research data obtained from NDRC projects other tha? 
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N-106 are identified as having been "furnished by projects of the 
National Defense Research Committee". 

Special mention should be made of the fact that this book does not 
contain accounts of all the personnel research done in or for the 
Navy. Research in aviation psychology and clinical psychology was 
under the cognizance of the Bureau of Medicine and Surgery, as was 
a major share of the work on the selection, classification, and train- 
ing of submarine personnel. Research on the design and use of 
aviation training devices was under the direction of the Special 
Devices Division, Bureau of Aeronautics. Research, in addition to 
that sponsored by the Bureau of Naval Personnel, Bureau of Medi- 
cine and Surgery, or Special Devices Division, was done by personnel 
stationed in the Navy Department in Washington and at various 
field activities and on units afloat. Finally, there is the extensive 
contribution of the many projects of the National Defense Research 
Committee, not only to the Bureau of Naval Personnel's program 
but to the many field stations and training activities. 


The studies and tests discussed in this volume are the result of the 
team effort of a large number of individuals. In a sense the authors 
of the various chapters are serving as reporters or interpreters of the 
work done in particular areas. Since it would be extremely difficult 
to make appropriate acknowledgements (except in a few instances) 
for the specific contributions made by each person, a group acknowl- 
edgement is made by the listing of names in Appendix A. 

The success of the Bureau's test construction and research pro- 
gram is in large part due to the capable leadership of Lt. Comdr. Ray 
N. Faulkner, Officer-in-Charge of the Test and Research Section. His 
ability to weld the work of a large number of individuals into a team 
effort, to plan the program of the Section and to coordinate its work 
with that of other units of the Bureau was outstanding. His criti- 
cisms and suggestions in the preparation of this manuscript have 
been very helpful. 

The accomplishments in research and test construction would not 
have been possible without the assistance and cooperation of various 
persons in the Training, Officer Personnel, Enlisted Personnel, and 
Research Activities of the Bureau of Naval Personnel. Grateful 
acknowledgement is made to Commander Alvin C. Eurich, Captain 
Carleton R. Adams, Captain Lot Ensey, successive directors of the 
Standards and Curriculum Division, Training, and the successive 
assistant directors, Lt. Comdr. Frank H. Bowles, Commander Paul A. 
Jones and Captain A. John Bartky for their assistance in planning 
and carrying out the program of the Test and Research Section; to 
Captain James B. Hogle and Lt. Comdr. James A. McCain of the 
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Enlisted Classification Section, and Lt. Comdr. John Н. Cornehlsen 
and Lt. Comdr. David G. Price of the Officer Selection Unit for their 
cooperation in providing the administrative facilities for experi- 
mental test tryouts and in making available some of the basic data 
used in research studies; finally to Captain William G. Cooper, 
Director, Research Activity, under whose leadership the Test and 
Research Section was clevated to the division level and the first 
nhases of the peacetime iest development and personnel rescarch 
program were planned. 

Special thanks are also due Mr. John Stalnaker, Mr. Henry 
Chauncey, and Dr. Harold O. Gulliksen of the National Defense 
Reseirch Committee Project N-106 and the College Entrance Exam- 
ination Board, who gave outstanding technical assistance in carrying 
through the Burean’s test construction and personnel research pro- 
gram; to Dr. Charles W. Bray and Dr. Dael L. Waolfle of the Applied 
Psychology Panel for their interest and encouragement in the prepa- 
ration of this book and for assistance in making available to the 
Bureau the rescarch findings and instruments developed by the 
projects of the National Defense Rescarch Committee. 

In the editorial preparation of this volume the virtual collabora- 
tion of Dr. Helen R. Haggerty was of the greatest assistance. She 
went over the manuscript in great detail and was completely respon 
sible for organizing the tables in consistent format. In addition she 
offered many constructive suggestions with respect to the organiza- 
tion and presentation of the material. 

Dewey B. STUIT 


Editor 
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PART I 


THE NAVY'S SELECTION, CLASSIFICATION 
AND TRAINING PROGRAMS 


CHAPTER I 


PERSONNEL RESEARCH 
AND TEST DEVELOPMENT IN THE BUREAU 
OF NAVAL PERSONNEL: 
HISTORY AND SCOPE OF THE PROGRAM 


Унем war came to the United States in December 1941, the Navy 
faced the biggest personnel problem in its history. Because the Navy 
had remained relatively small during World War I, it had not been 
necessary at that time to establish an extensive personnel program. 
Procuring, classifying, training, and assigning to duty the four and 
one-half million officers and men required to man the ships and 
shore stations in World War II called for modern personnel tech- 
niques. In order to avail itself of the experience of government, edu- 
cation, and industry in personnel procedures, the Navy sought the 
assistance of various outside agencies and reorganized its internal 
Organization in order to apply up-to-date techniques to its personnel 
problems. A direct result was the establishment within the Bureau 
of Naval Personnel of a unit of personnel trained in psychology 
which became the Test and Research Section. The development of 
this Section, its mission and organization, are the subject of this 
chapter. 

MISSION or THE TEST AND RESEARCH SECTION. The Test and 
Research Section (since January 1946 the Test and Research Divi- 
Sion) was established to develop tests and carry on research studies 
designed to assist in selecting, classifying, and training officers and 
enlisted personnel from the time they are examined for admission to 
the Navy, through their indoctrination or basic training and spe- 
Clalized technical preparation, until they are satisfactorily assigned 
to duty aboard ships or at shore stations. Specifically, the Section’s 
Mission has been: 


І. To construct, evaluate, recommend, and approve the adoption of 
Psychological and educational tests and other instruments for use in 
determining the qualifications of applicants for admission to the naval 
Service; in classifying personnel for technical training and for types of 
duty assgnments; and in measuring achievement in naval training pro- 
grams; 

2. To conduct research on the effectiveness of tests and other instru- 
ments used in selection, classification and training programs; on the 
effectiveness of selection and classification procedures; on the effectiveness 


of training; and on the performance of naval personnel in their duty 
assignments. 
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ADMINISTRATIVE ORGANIZATION OF THE TEST AND RESEARCH SEC 
TION. The Bureau of Naval Personnel is responsible for the procure 
ment, education, training, discipline, promotion, and distribution 
of officers and enlisted personnel of the Navy, except for the gie 
fessional education of officers, nurses, and enlisted men of the ie 
cal Department. From November 1942 through October 1915, ier 
period during which the studies reported in this volume were = : 
taken and in large measure completed, the personnel test deve и: 
ment and research program was developed in the Training Activity 
which has cognizance over naval training. и 

The administrative organization of the Test and Research Sectio 
in relation to the Bureau is shown in Figure 1; the organizatie 
and staff of the Section is shown in Appendix А-1. The responsibi 
ties of the four Units in the Section have been as follows: Р 

Selection Test Unit. Development and validation of aptitude oats 
for officers and enlisted personnel; and advancement in rating еха 
inations for enlisted personnel. sith 

Achievement Test Unit. Construction and evaluation of achie 
ment examinations and other devices to measure the proficiency 9 
officers and men in training programs. extitit 

Research Unit. Conduct of research on problems of classificat 
and training of officer and enlisted personnel. of 

Radio Materiel Unit. Development of a coordinated program a 
test construction and research on selection, classification, and tra! 
ing of radio technicians. st 

SCOPE AND SERVICES ТО NOVEMBER 1945. The work of the v 
and Research Section has originated either as projects initiated 
the Section or in response to requests made by Navy activities a 
assistance on specific problems. The extent of the use of tests 4 
results of research studies and the technical services rendere 
Navy programs may be summarized as follows: 


To the Bureau of Naval Personnel and its Field Activities: А 
1. The Officer Procurement Division, the Officer Distribution pivisio; 
the Enlisted Recruiting and Induction Division, and the Enliste d 
tribution Division have made use of selection and classification {655 s d 
the results of research studies in establishing and revising selection 
classification procedures. : 1198 
2. Reserve Midshipmen’s Schools, Naval Reserve Officer T d 
Corps Units, Naval Training Centers and Naval Training Schools: * ed 
other training programs for officers and enlisted personnel have | 
achievement examinations for evaluating performance of indiv? 
trainees and efficiency of training. ic 
3. Instructional and classification staffs have been given tech ug 
assistance in techniques of using test results, in techniques of develoP 
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Figure 1-1. Bureau of Naval Personnel organization as of July 15, 1945. 
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tests for specific situations, and in development and improvement of 
grading systems. 

4, The Educational Services Section has used the results of research 
studies in evaluating the program of off-duty education and orientation. 


To Other Personnel and Training Programs: 


1. The Training Commands of the Atlantic and Pacific Fleets have 
made use of the Section's tests and research findings in fleet schools, team 
training centers, and pre-commissioning centers. 

2. 'The Amphibious Training Commands of thc Atlantic and r 
Fleets have used tests and the findings of research studies in their cl 
fication and training programs. =" 

3. The Fleet Commands have used the fleet edition of the Basic Test 
Battery in classifying enlisted personnel for types of duty and assignment 
to advanced service schools. А 

4. At the request of the Office of the Commander-in-Chicf, the Section 
has conducted research on the performance of personnel aboard ship, 
in order to improve selection, classification, and training. " 

5. Examining Boards on ships and at shore stations have used advance 
ment in rating examinations in determining eligibility of enlisted рё 
sonnel for petty officer ratings. 


асі 
assi- 


Personnel Testing and Research in the Navy 
before November 1942 


Although psychological tests were in use in the Navy as early | 
1912, there is no record of an organized program for testing T 
personnel prior to 1924, when the Training Division was establish n 
in the Bureau of Navigation. At that time a General Слава са о 
Test was used in training stations to select enlisted men for Na 
schools. Later this test was given at recruiting stations; as а x 
men were eliminated at the recruiting level rather than afte 150 
had enlisted in the Navy. Other tests of special aptitudes Were g^ 
introduced. Sometime before 1941 the use of these tests Was sesto 
to the recruit training activities. In December 1941 the follow? 
tests were in general use: General Classification Test, Mechan? 3 
Aptitude Test, Arithmetic Test, English Test, Spelling Test 
Radio Aptitude Test. 1d 

Useful as these tests had been in peacetime when the Navy cov e 
select among applicants for enlistment, they were not adequate ae at 
pressure of filling school quotas from limited sources became gH 
Throughout several months before and just after December . 
many persons on ships and stations and at training installa? s, 
became acutely aware that not all the men being sent from ui 
training to naval training schools were capable of being trained 
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their specialties. They were also discovering that the tests in use for 
selecting these men did not differentiate, for example, between good 
candidates for radioman training and good candidates for store- 
keepers schools. As a result, "home grown” testing programs devel- 
Oped at many establishments, and from a number of sources requests 
for and comments upon testing programs converged upon the Train- 
ing Division in the Bureau of Navigation (after 13 May 1942 the 
Bureau of Naval Personnel), and upon the Office of the Commander- 
in-Chief of the United States Fleet. In April and May 1942, through 
correspondence and conferences, some of the specific problems re- 
garding testing became focused, and request was made on May 2 
by the Bureau of Navigation to the Office of Scientific Research and 
Development for advisory assistance in the solution of the Navy's 
testing problems. 

For several months thereafter, two parallel approaches toward im- 
proving the Navy’s testing program were developing, one within 
the Training Division in the Bureau of Naval Personnel and the 
other on a contract basis under the National Defense Research Com- 
mittee, 

THE PROGRAM IN THE TRAINING Division то NOVEMBER 1942. 
Throughout the summer and early fall of 1942 the Bureau of Naval 
Personnel was coming to grips with some of the immediate personnel 
problems facing the expanding Navy. Training, always a major 
activity of the Navy, loomed large as increasing numbers of un- 
trained personnel were procured, and as the demand for skilled 
technicians in many branches multiplied rapidly. Training programs 
for enlisted men increased. It became more and more imperative 
to be able to assign recruits to training schools so that there would 
be the least possible attrition. As a result, a survey of the existing 
Navy tests, of Army tests, and of commercial tests which might be 
adequate for selecting enlisted men for naval training schools was 
stituted. The procurement of a large number of men from civilian 
life to be commissioned as officers presented a similar need for the 
development of a test to be used at Offices of Naval Officer Procure- 
ment to assess the qualifications of these men. 

An increase in personnel in the Bureau of Naval Personnel was 
necessitated to carry on these activities, and during the summer of 
1942 several psychologists were commissioned to assist the Civilian 
Educational Advisor, who until June 1942 had been the single pro- 
fessional expert on test construction in the Bureau. Work was thus 
begun on the development of an officer test, on the revision of the 
existing enlisted battery of tests, and on the study of tests for selec- 


и ОЁ personnel for special programs in sound schools and radio 
Schools. 
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Tur CONTRACT Procram то NOVEMBER 1942. Following the re 
quest in May of the Chief of the Bureau of Navigation for advisory 
assistance with the Navy’s testing program from the Office of Scien- 
tific Research and Development, a series of conferences between 
naval personnel and members of various research апа scientific 
groups was held. Army personnel were also contacted, In June 1942, 
the Committee on Selection and Training of Service Personnel was 
set up in the National Research Council, financed under a contract 
between the National Research Council and the National Defense 
Research Committee. As stated in the minutes for June 20, 1942, 
the Committee, organized as OSRD Project N-100 (later to become 
the Applied Psychology Panel), was to be “informal, quick, and 
direct, of as much use to the Navy and Army as possible, and would 
work always with the understanding that it would do only those 
things which it is asked to do by the Navy and Army.” . 

The first activity of the Committee was to familiarize itself with 
the problems of Navy training through a series of trips to Navy 
establishments. Following these trips, a number of recommendations 
for test construction and research were made on July 25, 1942 to 
the Chief of the Bureau of Naval Personnel. ; 

In the meantime, early in June 1942, the College Entrance Exam 
nation Board had been requested to prepare an examination for use 
in procuring officers for the contemplated Women's Reserve, and 
work was begun on this examination. Preparation of a test for use 
in procuring enlisted women was also started. By the first of Sep: 
tember these projects were approved and placed by the Nationa 
Defense Research Committee under the Committee on Selection anc 
Training of Service Personnel as Project N-106 (Research and Deve” 
opment of the Navy's Aptitude Program). f 

ACCOMPLISHMENTS TO NOVEMBER 1942. These two programs E 
study of the Navy testing and training problems, one within the 
Navy and the other under contract, continued somewhat inde 
pendently of each other until the late fall of 1942. 

By that time the personnel in the Navy program had increased 
a number of psychologists had been commissioned and assigned 
naval training programs to assist with selection and classificatio” 
procedures; some studies had been made within the Navy of thi 
existing Navy tests, a few commercial tests had been recommen 
for use in special programs; and work had continued in the Мач 
оп the development of a short form of an officer test to be used ? 
offices of naval officer procurement. 

Under the contract program, women officers had been give” : 
series of tests; one test had been developed for use in the procu t 
ment of enlisted women; one form of an Officer Qualification ge 


, 
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was developed; and studies had been done on the reliability and 
validity of the existing enlisted tests and on a Naval Reserve Officer 
Training Corps Selective Examination in use in colleges and uni- 
versities. 


Administrative Organization: November 1942 
to November 1945 


THE INITIAL ORGANIZATION. When the Bureau of Naval Personnel 
was established in May 1942 to supersede the Bureau of Navigation, 
an organization of management counselors was hired to make a 
comprehensive survey of the scope and functions of the Bureau. 
Their recommendations, designed to render more efficient the 
Navy's personnel program, were presented on August 20, 1942; and 
for a number of weeks thereafter, personnel in the Bureau were in 
process of studying, evaluating, and implementing the recom- 
mendations. 

By November the organization within the Bureau had been 
greatly modified. Within the Training Division of the Bureau, the 
Standards and Curriculum Section was established early in Novem- 
ber, and made responsible for developing specific answers to three 
basic questions stated in the survey report: 


(1) What are the requirements men must meet in order to be selected 
for training in various subjects? 

(2) What should they be when they have finished training, i.e. precisely 
what qualifications should they have gained from the training? 

(3) In the light of (1) and (2), what must they be taught? 


Three units were established, each to prepare the answer to one of 
the above questions: Selection Requirements Unit, Training Stand- 
ards Unit, and Curriculum Unit. 

Within the Selection Requirements Unit, designed to answer the 
first question "by devising the best possible methods for the proper 
Selection and classification of enlisted personnel and officers in the 
Navy", five groups were soon set up. Two of these groups were 
made responsible for developing general plans for the selection 
process and for implementation of these plans (Officer Selection 
Group and Enlisted Selection Group) *. Three Groups were estab- 
lished to provide tests and research data (T'est Construction Group, 
Research Group, and Quotas by Grade Group). 

The Test Construction Group was made responsible for the devel- 
opment of tests, the Research Group for studies of classification and 


lIn the spring of 1944 these two programs were transferred to Officer Personnel 
Activity and Enlisted Personnel Activity respectively. See Figure 1-1. 
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training problems, and the Quotas by Grade Group for establishing, 
for different types of training, quotas for enlisted men with varying 
levels of ability. NDRC Project N-106 was continued as a service to 
the Navy's testing and research program, and a number of other 
National Defense Research Committee projects on special phases of 
classification and training were later established. 

Скоутн OF THE PROGRAM. As the program of the Standards and 
Curriculum Section developed, it became necessary to add units and 
to reorganize certain aspects of the organization. On August 24, 1913 
the T'est and Research Unit was established within the Section, with 
the staffs of the Test Construction Group and the Research Group 
forming the nucleus of the new Unit. Its program was to construct 
and validate classification tests for enlisted personnel and officers 
and to conduct any rescarch necessary to improve the efficiency of 
the classification and training program. 

On September 23, 1943, at the suggestion of Quality Control 
Division, Training, the Test and Research Unit was officially 
charged with the responsibility for developing final achievement 
examinations for naval training schools. By January 1944 an 
Achievement Test Group was organized and work was begun on. 
examinations for schools for Yeomen, Storekeepers, Electrician > 
Mates, Quartermasters, and other specialties. In May 1944, a pro 
gram was initiated to construct examination materials for use PY 
boards in determining qualifications of enlisted personnel for ас” 
vancement in rating. In the summer of 1944, preparation of per 
ment examinations for officer training programs was inauguratec- 
In December 1944, work commenced on an achievement examina 
tion for recruit training. : 

Throughout the war the training of radio technicians was опе of 
the most strategic and technical in the Navy. In January 1944, the 
program of test construction and research on training for this rating 
was organized as the Radio Materiel Group in the Test and Research 
Unit. 

On January 1, 1945, the Test and Research Unit became the Test 
and Research Section, in what was by this time the Standards an 
Curriculum Division in the Training Activity. Late in 1944 / 
series of special studies had been instituted to evaluate naval training 
programs. During 1945 this undertaking was expanded to inclu us 
such projects as the analysis of attitudes of men in the amphib/o 
forces, the extent of use and influence of the Navy's Educatio | 
Services and War Orientation program, the use by Navy perso? à 
of the facilities of the United States Armed Forces Institute. the 

During 1945, also, attention was focused on the validation 11 d 
fleet of classification and training procedures; the construction a 
validation (in cooperation with the Bureau of Medicine and Surge? 
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of instruments to detect combat fatigue and related psychological 
disabilities; and the development and use of tests and research 
results in the Navy literacy training program, in transferring reserve 
officers to the regular Navy, in standardizing instruction in Naval 
Reserve Officer Training Corp Units, and in selecting candidates 
for the Naval Academy at Annapolis. 

The program of the Test and Research Section in November 1945 
was thus directed toward the development of research studies and 
psychological and educational tests for reconversion and for peace- 
time personnel programs. 


The Continuing Program 


TRANSITION. Throughout the war period the greater part of the 
test development and personnel research program of the Bureau of 
Naval Personnel was carried on by the Test and Research Section. 
Research projects, however, were developed by other groups within 
the Bureau. Enlisted Billet Analysis Section, Standards and Curricu- 
lum Division, was responsible for the continuing study of the nature 
of Navy billets for enlisted personnel. The Officer Billet Analysis 
Section, Officer Personnel Activity, performed comparable research 
for officer billets. Field Research Section, Planning and Control 
Activity, undertook to conduct opinion polls and planning surveys. 
As the programs of personnel research developed, and as plans were 
being formulated for continuing into the peacetime Navy the essen- 
tial aspects of personnel research and test development, it became 
apparent that the several research groups could function more effi- 
ciently through closer integration of their programs. Accordingly, 
on November 5, 1945, the four sections were combined to form the 
Research Division in Planning and Control. On January 4, 1946, 
Research was raised to the Activity level and the Test and Research 
Section, together with the other sections, was raised to Division level. 

THE РЕАСЕПМЕ Procram. Plans for a permanent research or- 
ganization in the Bureau of Naval Personnel were officially approved 
in January 1946. The Research Activity will undertake a coordi- 
nated program of personnel research and test development centered 
around the major personnel problems of the Navy. It is contem- 
plated that the overall mission of the Activity will be (1) to conduct 
studies on personnel, policy, techniques, and procedures, and on the 
assignment, evaluation, promotion or advancement, and morale of 
officer and enlisted personnel; and (2) to develop such psychological 
and educational tests and other instruments as may be necessary for 
the selection, classification, training, and evaluation of performance 
of Navy personnel. Within this organization will be subsumed the 
wartime functions of the Test and Research Section. 


CHAPTER П 


SELECTION AND CLASSIFICATION 
OF OFFICER PERSONNEL 


BETWEEN the years 1941 and 1945 the Navy was confronted with the 
task of procuring nearly 300,000 officers to meet the needs of the 
expanded fleet. These officers were required to fill hundreds of 
different billets ashore and afloat, some very similar to civilian occu- 
pations, others very different. It was important that these men and 
women be procured and assigned for training and duty so that their 
education, experience, and aptitudes might be used effectively. The 
procurement and assignment of these personnel were the respective 
responsibilities of Officer Procurement Division and of Oflicer Dis 
tribution Division, Officer Personnel Activity. 


The Procurement Process 


CoMMISSIONING FROM CIVILIAN Sources. Applications of civilians 
for direct commissioning in the Naval Reserve were processed by 
offices of naval officer procurement. Each applicant, upon coming 
to an office of naval officer procurement to make application, was 
required to complete a standard application form which yielded 
fairly complete information regarding his background and training 
Applicants found to be initially qualified for consideration for 
commissioning were administered physical examinations and psycho- 
logical qualification tests, and were interviewed by two officers. 

The Officer Qualification Test was used as a screening device for 
evaluating applicants with a great variety of backgrounds and for 
determining the individual's ability to be of service to the Navy: 
Two interviews were given to all apparently acceptable candidates 
in order to obtain the judgment of two different individuals as [0 
the applicant's potentialities. The primary purpose of the interview 
was to determine (1) the general qualifications of each applicant 
and (2) where each applicant might be of most service to the Navy» 
in terms of the available billets and the needs of the service. Each 
applicant found to be acceptable on the basis of the physical exami- 
nation, test results, and interviews was investigated through refer- 
ences, friends, employers, city and state police, or the Federal Bureau 
of Investigation. 

If the applicant was found qualified for final consideration fot 


one or more types of duty open to procurement at that time, his 
12 
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record was forwarded to the Bureau of Naval Personnel together 
with recommendations as to the types of duty for which he appeared 
to be best suited. In the Bureau, records of recommended applicants 
were routed to special reviewers, each reviewing applications in the 
light of the individuals’ qualifications for particular types of duty. 
Applications were rejected only when they had been examined by 
all reviewers who could possibly recommend appointment of the 
applicants. Applications found acceptable were routed, recommend- 
ing appointment, to a final review board whose function was to 
make the final recommendation as to appointment or rejection. 

COMMISSIONING OF ENLISTED PERSONNEL. The same opportunities 
afforded to civilians for commissions in the Naval Reserve were open 
to enlisted personnel. Enlisted personnel in recruit training were 
screened by classification officers and those found basically qualified 
for commissions had the opportunity to apply. Furthermore, any 
enlisted man at the end of a six-month period was given the oppor- 
tunity to apply for a permanent commission in the Naval Reserve. 
Information similar to that required of civilians was required of en- 
listed applicants. Applications of enlisted personnel were reviewed 
in the Bureau of Naval Personnel in the same manner as were those 
from civilian sources. 

The V-7 program also was open to enlisted personnel under thirty 
years of age who had completed two years of college. Personnel 
selected for V-7 training by the Bureau of Naval Personnel were 
ordered to midshipman training either directly or via a brief period 
ОЁ academic refresher training. In addition, commanding officers 
Were requested to submit recommendations for temporary appoint- 
ment of qualified enlisted personnel to commissioned rank. These 
recommendations were reviewed and approved or disapproved by an 
administrative board established in the Bureau. "m 

V-12 PnocunEMENT. V-12 personnel were selected from civilian 
sources to enter upon active duty on July 1, 1943, November 1, 
1943, and July 1, 1944. Initial selection was made by means of 
nationwide tests administered in high schools and colleges through- 
Out the country. Final selection of physically qualified applicants 
Was made by state selection committees composed of business men, 
educators, and naval officers. Selection was based upon test scores, 
high school and college records, and the results of interviews given 
at offices of naval officer procurement. Enlisted personnel were also 
Selected for V-12 training by commanding officers of ships and shore 
Stations in accordance with procedures outlined in Bureau directives. 
Insofar as possible, the same selection requirements outlined for 
civilians were followed in selecting V-12 candidates from enlisted 
ranks. 
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V-1 AND V-7 PROCUREMENT. Prior to the entry of this country into 
the war, the V-7 program was established. The V-7 program at that 
time was open to candidates who had successfully completed two 
years of college. Following induction, officer candidates were subject 
to call to active duty for training cruises and were eligible for com- 
missioning upon completion of college. Following the beginning of 
the war, the training cruise phase of the program was eliminated 
and V-7 trainees were called, upon graduation, to active duty for 
midshipman training in reserve midshipmen’s schools, at the end of 
which they were commissioned. 

The У-1 program was opened in early 1942 to freshmen and sopho- 
mores as a companion program to the V-7 program. Personnel en- 
listed in the V-1 program were to be retained on inactive duty until 
graduation, at which time they were called to active duty in midship- 
man training status. The larger part of these enlistees were trans 
ferred to V-12 upon the opening of that program. 

Selection for both the У-1 and the V-7 programs was based upon 
physical fitness, academic record, and "officer-like" qualities. Stu- 
dents in these programs were required to complete certain required 
courses prior to graduation from college and subsequent admission 
to reserve midshipmen's schools. 


Classification of Officers 


When the officers had been procured, it was the task of the Officer 
Distribution Division, Officer Personnel Activity, of the Bureau 9 
Naval Personnel so to distribute them as to make maximum 086 e 
the skills and experience which they already possessed. Officers were 
urgently needed to man the ships which were sliding down = 
ways in a production program of unparalleled scope. Time m 
training them was short; consequently each officer had to be lace 
so that, insofar as possible, his civilian education and experienc 
could take the place of the extensive naval training which he wou 
have received in peacetime to prepare him for his assignment. 
the paragraphs that follow, a brief description is presented of the 
selection and classification process. 

CLASSIFICATION AT RESERVE MIDSHIPMEN’S AND INDOCTRINATION 
ScHoors. The Officer Selection Unit (first established early in 194° 
in the Standards and Curriculum Division, Training Activity, ай” 
sud da early 1944 to the Officer Distribution Division, DE 
di NY ^ enm was immediately concerned with the graduate 

vy ctrination and reserve midshipmen's schools. The 
new officers, about to embark upon their first Navy assignment 


wi 1 | H EH e 
ere ideal subjects for classification. Interviewing officers were © 
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signed to each indoctrination and reserve midshipmen’s school to 
assist the Bureau of Naval Personnel in placing the graduates. The 
interviewers themselves were carefully chosen. Many of them had 
graduate degrees in psychology, and all of them had had extensive 
pre-Navy experience in personnel work in industry or in colleges 
and universities. 

These interviewers were first given a training course under the 
direction of the Officer Selection Unit. They studied the system of 
officer detailing by which the Bureau of Naval Personnel distributes 
all naval officers. They were coached in the program of testing, inter- 
viewing, and recommending which was to be standard in every mid- 
shipmen's and indoctrination school. And finally they went on a 
field trip to various naval bases so that they might learn first hand 
about duty aboard various types of ships and stations. During this 
trip they “hit the beach" in a practice landing from an LSM, made 
a run in a PT boat, and spent a day on an anti-submarine patrol. 
They went aboard dozens of ships of many types and visited the 
classrooms and laboratories of advanced training schools of various 
kinds. At the end of this training, the interviewing officers took up 
their posts at the indoctrination and midshipmen's schools, prepared 
for the task of selecting new officers for their first naval duties. 

The selection program at these schools fell roughly into three 
sections: (1) acquainting the new officers with the kinds of naval duty 
open to them, (2) evaluating each officer's qualifications and prefer- 
ences for duty through testing and interviewing, and (3) making 
recommendations to the Detail Section, Officer Distribution Divi- 
sion, Officer Personnel Activity, Bureau of Naval Personnel, for the 
distribution of each graduating class. 

The interviewing officer introduced the subject of naval duty to 
the midshipmen or indoctrinees in a “billet lecture". Here he briefly 
described the assignments afloat or ashore in which the new officers 
might be placed, paying particular attention to those spots where 
Officers were most urgently needed at the moment. The pattern of 
officers in demand in certain duties changed constantly with the 
Progress of the war, so that the billet lecture for one indoctrination 
class might differ considerably from that for the next month’s class. 
The student officers had to be prepared for the possibility that even 
in the time between the billet lecture and the assigning of the class, 
the exigencies of the war might eliminate certain needs and create 
others. The interviewing officer tried always to foster in the students 
the realization that their individual aptitudes and qualifications had 
to be utilized in relation to prosecuting the war. A man might have 
had years of successful experience as a trial lawyer, yet at a time 
when the amphibious program was desperately in need of officers, 
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his one or two summers of small boat handling might have far more 
significance. | 

The second and perhaps most important function performed by 
the interviewing officer was making an evaluation of each officer's 
best potential contribution to the Navy. ‘This was accomplished by 
testing and by interviewing. Every officer was given the Oficer Classi- 
fication Test, a four-part battery designed to measure verbal facility, 
mechanical aptitude, mathematical competence, and ability to vis- 
ualize spatial relations. Those officers who appeared to be candidates 
for such specialized training as radar materiel or tactical radar were 
given the selection tests developed for these types of папила. The 
construction and validation of these tests is described in Chapter 
УШ. 

Testing took place before interviewing, so that at the time о! the 
interview each candidate's test scores were before the interviewing 
officer. These scores, together with the officer's background, civilian 
or naval, his indoctrination or reserve midshipmen's school marks. 
and his own choice among the assignments open to the class, together 
with his appearance, physique, and personality made up the general 
picture from which the interviewer made his estimate of the person $ 
abilities. 

The interviewing officer's recommendations to the Bureau меге 
the result of matching the individual sets of aptitudes to the jobs 
open to the class. To aid him in this task the interviewing office! 
had at hand the Billet Selection Requirements Manual, compiled by 
the Officer Selection Unit. This manual which was continually in 
process of revision listed some one hundred sea and shore assign" 
ments with the qualifications considered desirable or essential ue 
each—educational background, civilian experience, minimum test 
scores, and personal qualities. 

'The interviewer's recommendations for assignment WCIC trans 
mitted to the Bureau on Duty Recommendation Forms. These forms 
contain a record of each individual's qualifications, grades, and test 
scores, a statement of his choice of duty, and the interviewer's recon 
mendation. 'The information on these sheets was especially valuable 
in those instances where shifting war needs necessitated a distribu- 
tion of officers different from that on which the interviewer had bas¢ 
his recommendations. The Duty Recommendation Form became ? 
part of each officer's record, to be used at any time when ће becam? 
available for transfer or when he requested change of duty. -— 

The effect of this program at reserve midshipmen's and indoctrin? 
tion schools was to reduce the time necessary for training office"? 
for competent performance in their Navy billets. Likewise it kep 
to a minimum the number of officers who "bilged" from speci? 
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training courses. The contribution to officer morale made by соп- 
sidering each man’s duty assignment individually, while it cannot 
be measured in tangible form, appears to have been considerable. 

CLASSIFICATION AT OPERATIONAL TRAINING CENTERS. Interviewing 
and selection programs similar to those at indoctrination and reserve 
midshipmen's schools were carried out in many operational training 
activities such as the Destroyer Training School, the amphibious 
training bases, and the APA (attack transport) Pre-Commissioning 
School. In these schools, selection was on a different level; officers 
мете interviewed and their grades and test scores evaluated for the 
purpose of placing each in the most appropriate post aboard ship. 
While testing was done at these centers, the primary emphasis was 
placed on evaluating the data previously gathered on each officer in 
relation to a specific billet assignment. 

CLASSIFICATION AT NAVAL RESERVE OFFICER TRAINING CORPS 
Scuoors. The Navy college training programs such as V-12 and 
Naval Reserve Officer Training Corps trained a great many officers 
for commissioning. These units were located at colleges and uni- 
versities all over the country and the separate groups were too small 
to warrant full-time interviewing officers for each. Interviewing and 
selection of these men for their first duties as naval officers were 
carried out by traveling interviewing officers from the Bureau of 
Naval Personnel. The students were given billet lectures, received 
informational pamphlets about naval duties, took the Officer Classi- 
fication Test and various special aptitude tests, and were interviewed 
by the representative of the Bureau. The recommendations of the 
Interviewer were sent to the Bureau on Duty Recommendation 
Forms, in the same manner as were recommendations for persons in 
midshipmen's and indoctrination classes. 

CLASSIFICATION ABoarD SHIP. The classification of officers aboard 
Ship was a relatively late development due to the fact that primary 
€mphasis was placed on the processing of personnel to be assigned 
to training programs or new ships. In the spring of 1945, however, 
Several requests for assistance in the classification of their officer 
Personnel were received from commanding officers of ships being 
shifted from the European to the Pacific theatre of operations. Prin- 
Cipally, the commanding officers of these ships were officers who had 
had tours of duty at naval training stations or other activities where 
the classification of officer and enlisted personnel was accepted as a 
Standard procedure. In the shipboard programs the classification of 
Officers was usually carried out at the same time as for the enlisted 
Personnel, By V-J Day the officer personnel of more than twenty 
large ships had been processed. Included in a complete shipboard 
Classification program were the following: administration of classifi- 
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cation tests; interviewing each officer; bringing up to date the Officer 
Qualifications Record Jackets; explaining the findings of the classifi- 
cation program to the executive officer or commanding officer or 
both; and making recommendations concerning the use of the data. 
Ideally, classification data should be obtained on all officers before 
they are assigned to duty, but since this had not been done, ship- 
board classification offered at least one opportunity to include officers 
in the program who had not been processed before assignment to 
duty. 

INTERVIEWING OF OFFICERS RETURNING FROM SEA FOR REASSIGN- 
MENT. In the spring of 1945, classification-interviewing was instituted 
at the ports of entry through which officers passed on returning from 
sea duty. Each officer was given a comprehensive interview with an 
experienced interviewing officer, during which his qualifications for 
next duty were reviewed. During the interview he could ask ques 
tions about the availability of billets in which he was interested and 
obtain first-hand information on Navy practices with respect to 
rotation and leave. In turn, the interviewing officer asked him ques 
tions necessary to obtain a complete summary of his naval anc 
civilian skills and interests. 
| А Duty Recommendation Form was used for transmitting the 
interviewer's recommendations to the Bureau. This Duty Recom- 
mendation Form was a variant of the one used at naval training 
activities, providing more space for listing naval experience, anc 
eliminating the space for recording test scores and grades. 

In contrast to the fairly precise quotas for distribution of the 
officers which were available for interviewers at reserve midship* 
men's and indoctrination schools, interviewing officers at ports 9 
entry had no specific quotas to guide them. They were, however: 
supplied with monthly reports of sea billets open, which indicate 
the acuteness of the needs in certain areas, and with monthly reports 
of the shore jobs open, with the qualifications required in each. 

Having familiarized himself with these reports from the Bureau) 
а cad аи assist the returning officer to state pa 

; : ght of the billets available. The interview? 
were, in fact, in such close touch with the Bureau of Naval Perso" 
е а iens spent by returnees in the port of entry office wa 

he eq alent for each of a personal visit to the Bureau. The inter 
viewer could prepare the returnees in general for what they co" 

a a ipa meii a ayia the ramifications © 

could effectively st oe ge sega aod a dutyi ic 

icd e md stop | of the fallacious rumors with v 
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their next assignments and to insure their better performance in 
whatever jobs they were placed. 


Officer Classification Records 


Because of the speed with which the Navy had to be expanded, 
there was no time for selection and classification activities to be 
established in the early months of the war. Hence many naval officers 
were assigned to duty where the need was greatest, with little regard 
for their preferences or qualifications. This was inevitable. But these 
officers too, and in fact all naval officers, were eventually covered 
by the International Business Machines punched card classification 
and records system. 

The basis of the I.B.M. punched card system is the Officer Qualifi- 
cations Questionnaire which each officer fills out and files with the 
Bureau. This questionnaire lists all his important qualifications— 
foreign language facility, foreign travel, education, civilian experi- 
ence, and naval duties. The qualifications of each officer are trans- 
posed into numerical code which is punched into cards. The cards 
then become an index to the questionnaires and can be drawn upon 
whenever an officer with a specific set of qualifications is required for 
а special job. The card system also serves as a medium for making 
officer personnel surveys and studies upon which to base plans and 
policies, 

One copy of the Officer Qualifications Questionnaire becomes the 
foundation of the Officer Qualifications Record Jacket. This jacket 
is carried by each officer from one duty station to another. Besides 
the questionnaire, which sums up his education, civilian work ex- 
perience, and naval duties, the jacket contains a tear-off section from 
each fitness report submitted on the officer. This contains his name, 
file number, rank, classification, date of reporting, and a description 
of the duties performed since the last report. By means of this addi- 
tion to the jacket, the record of the officer’s qualifications is kept 
up to date. Another copy of the tear-off section of the fitness report 
is sent to the Bureau of Naval Personnel, where it is used to bring 
the punched card record up to date. 


Impact of Officer Classification on Navy Personnel Procedures 


Despite the late start of the officer classification program, it has 
had a significant effect upon the processing of officer personnel. As 
a result of the success of wartime officer classification, post-war plans 
for officer selection and classification include the following: J 
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1. Continuation of an Officer Qualifications Unit in the Officer Dis- 
tribution Division to carry on the various phases of an officer classification 
program. 

2. Maintenance by the Officer Qualifications Unit of accurate records 
on all officers to the end that each officer will receive shipboard expe 
rience in accordance with the Navy rotational training program. А 

3. Assignment of a technically qualified district personnel classification 
officer to each naval district to carry on officer classification activity after 
the reserve officer personnel have been demobilized. . 

4. Sending of interviewing officers to the Naval Reserve Officer ‘Train 
ing Corps Units and other training activities as needed to assist in the 
classification of officer personnel and officer candidates. . 

5. Maintenance of up-to-date qualification records on reserve officer 
personnel by means of questionnaires sent out every two years to all 
officers on inactive duty. 

6. Administration, as needed, of officer selection and classification tests 
at training activities and other naval commands. " 

7. Continuation of the Officer Qualifications Record Jacket as the basic 
record for officer personnel. 


By the establishment of the above administrative procedures and 
classification techniques in peacetime, the Navy will, in the event 
of an emergency, be able to mobilize its officer personnel in a mint 
mum of time and assign them to billets where their abilities ап 
experience can best be utilized. 


CHAPTER III 


SELECTION AND CLASSIFICATION 
OF ENLISTED PERSONNEL 


In addition to the procurement and classification of the 300,000 
officers described in Chapter II, the Navy had to recruit, train and 
assign approximately four million enlisted personnel. Furthermore, 
the rapid technological developments of modern naval warfare in 
such fields as gunnery, fire control, aviation, and electronics required 
that enlisted men be trained for and assigned to more than eight 
hundred different types of jobs varying in complexity from the deck 
hand who swabs, chips paint, and polishes bright work, to the radio 
technician who maintains and repairs highly technical and complex 
radar and electronics gear. The tasks of classifying men for the type 
of work in which they would be most likely to succeed, and of aiding 
personnel officers in assigning each man to the right job was the 
responsibility of the Enlisted Classification Section of the Enlisted 
Personnel Activity of the Bureau of Naval Personnel. At the time 
of V-J Day more than 1,100 carefully selected classification officers 
and classification interviewers (enlisted personnel) had been trained 
and assigned to provide classification services at more than one 
hundred different naval activities ranging in function from recruit 
training centers to forward area personnel distribution points. 


Procurement of Enlisted Personnel 


Enlisted personnel were procured during the war primarily 
through Selective Service and secondarily through the voluntary 
Tecruiting program administered through recruiting stations located 
1n all large cities. Before the war, recruiting stations had been re- 
Sponsible for the procurement of all enlisted personnel. Applicants 
Were required to meet both physical and intellectual qualifications. 
A General Classification Test was used in addition to an educational 
requirement in estimating the intellectual capacity of applicants. 

During the war recruiting stations administered several special 
Procurement programs in addition to carrying on their normal re- 
Cruiting functions. In the radio technician recruiting program a 
Special test, the Radio Technician Selection Test, was administered 
to all applicants. For most other special recruiting programs, such as 
for combat aircrewman, ship repair units and construction bat- 
talions, selection at the recruiting station level was accomplished by 
an examination of the applicants’ educational and vocational ex- 
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perience. In the post-war recruiting program a psychological screen- 
ing device, the Applicant Qualification Test, will be used in addition 
to the usual physical and psychiatric screening examinations. 


Classification of Enlisted Personnel 


CLASSIFICATION AT Recrurr TRAINING COMMANDS. All personnel 
procured through Selective Service or recruiting stations were sent 
to recruit training commands (prior to 1944 naval training stations) 
for recruit training and for classification. Each classification office 
was under the direction of a classification officer, and all recruits 
were given a battery of classification tests and were interviewed by 
classification interviewers. The basic functions of classification 1 
recruit training were: (1) to determine and record on standard 
forms, the aptitudes, skills and abilities that would indicate the type 
of naval duty for which each recruit was best fitted; (2) to reconr 
mend each recruit for the type of training or duty for which he was 
best qualified; and (3) to effect the assignment of each recruit to that 
type of training or duty for which he was best fitted by matching the 
man’s qualifications with the Navy’s needs as reflected in quotas 
issued by the Bureau of Naval Personnel. 

These functions were carried out in accordance with the | 
available personnel techniques and methods. All recruits were first 
informed about available training schools and the duties of пауа 
ratings by means of carefully planned lectures, films, and pamphlets: 
They were then given the Basic Test Battery for enlisted personne i 

These tests included the following: General Classification Test, 
Reading Test, Arithmetical Reasoning Test, Mechanical Aptitu 
Test, Mechanical Knowledge Test (Mechanical), Mechanical Know™ 
edge Test (Electrical), Clerical Aptitude Test, Spelling Test, Radi? 
Code Test. 

. The tests were administered under conditions as ideal as was po* 
sible in view of space limitations, and were scored, for the most part 
by machine. Test scores were then checked and recorded by machint 
on each man's Enlisted Personnel Qualifications Card so that whe? 
the man appeared for interview, the interviewer had before him 1 
complete picture of the test results. Aptitude testing was an essentue. 
aie of recruit classification, providing the most. objective | 
nee ier fie dae ена even на Fg 
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When recruits possessed previous civilian experience and training 
closely related to types of work available for them in the naval serv- 
ice, test scores were of secondary importance except as they indicated 
that the man was of such a low mental caliber that he could not be 
expected to learn quickly enough to qualify for the duties of a rating. 
In order to facilitate the evaluation and recording of the recruit's 
civilian experience, training, hobbies, and interests, a standard aid- 
to-the-interview blank was completed by each man prior to the 
interview. This form gave the recruit an opportunity to list his 
qualifications and to express his interests in various types of Navy 
jobs. 

In the great majority of cases, it was a combination of a man's 
test scores, civilian work experience, motivation, previous training, 
and interests which guided the interviewer to a decision as to what 
types of duty the recruit was best qualified to perform. Duty recom- 
mendations were usually recorded in rather broad terms so that a 
man would not be too narrowly classified. This was necessary and 
desirable not only in the man's best interests but also because of 
variations in quotas from the Bureau of Naval Personnel which 
required flexibility in detailing. 

To facilitate school assignments, which constituted a major phase 
of recruit classification, certain basic data from the Enlisted Per- 
sonnel Qualifications Card were punched into I.B.M. cards for 
mechanical sorting so that selection could be rapid and accurate. 
In addition to the man's name, rating and service number, the I.B.M. 
selection card provided space for punching a civilian occupational 
code, an evaluation code and a first and second duty choice or 
recommendation. . 

Roughly speaking, about 40 percent of all recruits were selected 
for elementary naval training schools; about 10 percent were selected 
for special billets, immediate rating, or commissioning; and the 
remaining 50 percent were sent directly to ships or stations for duty 
as "general detail" hands. An adequate system for classifying this 
latter group was never fully developed and as a result many men 
Who had useful skills were often not used effectively in their subse- 
quent assignments. If an adequate classification system had been 
established earlier, it should have been possible to process the 
"general detail" population as well as the other groups. 

CLASSIFICATION AT PRE-COMMISSIONING CENTERS. Many recruits 
and some elementary school graduates were sent directly to pre- 
commissioning training centers where they were assigned to new 
COnstruction vessels. To assure continuity in the classification and 
assignment process it was necessary to establish classification centers 
at all such activities. The basic functions of classification at pre- 
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commissioning activities were to: (1) process and provide ine 
crews for new construction vessels; (2) provide sufficient information 
about each man assigned to a ship to assure his proper N s 
and (3) assist the ship's executive officer or personnel officer = 
technical aids and methods that would assure an effective system o 
personnel administration aboard ship. | а 
The majority of men detailed to new construction were n 
assigned to specific ships and this permitted the orderly — d 
and processing of all such men in order to assure each ship of its o 
share of high, medium and low caliber men. This process known "m 
"balancing the crew" was important, since otherwise one ship pes 
have been assigned all the better qualified men and another miga 
have received nothing but relatively poor ones. Aptitude test scor es, 
previous civilian experience and training, physical qualifications 
and the man's motivations were important factors in the palentung 
process. Accordingly, much use was made of the Qualifications n ; 
which, as stated earlier, was usually prepared for recruits shortly 
after their induction. If the card was not available or was incomplete: 
necessary steps were taken to complete it before assignment. : 
In addition to this information about the man, it was also rni 
sary to know the jobs available for the men aboard ship. Such 1n 
formation was secured by a review of the ship's complement eg 
discussion with department and division heads, if they were aval 
able, as to their views on desirable qualifications for types of атга 
The resulting job data were set up in card files so that the quali 
cations of the man and the job could be matched. . 
In order to man properly a ship's Watch, Quarters, and Station 
Bill, it was necessary to assign many men to jobs in gun crews an 
other battle stations on the basis of potential qualifications. To а! 
in this process, special selection devices such as the selectomete 
(developed by the National Defense Research Committee) and а 
sorting devices making use of selective placement factors were de 
veloped and used with varying degrees of success. Special tests were 
also used in this process, including the Ortho-Rater tests for singe 
acuity and other visual capacities, the Telephone Talker Test m 
selecting men who would be most suitable as talkers on soun á 
powered phone circuits, and the Sonar Pitch Memory Test for iden 


tifying men who possessed sufficient pitch discrimination to quali 
as sound gear operators. 


_ The remaining functions of classific 
ing centers were concerned with deve 
sonnel administration for each shi 
open Qualifications Card file, eit 
pending upon the size of the ship. 
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set up containing special data such as names of men possessing high 
test scores, college degrees, and special skills in foreign languages 
or experience as musicians or entertainers. These cross-index files 
were useful in filling special billets once the ship was commissioned. 
In addition, a cross-index file of men best qualified to "strike" (serve 
as apprentices) for petty officer ratings was established so that when 
vacancies occurred in any division, the most likely non-rated man 
on board could be selected and assigned for training to fill the va- 
cancy. Finally, an officer and yeoman were trained in the use and 
interpretation of information contained in these files and in the 
technique of keeping them up-to-date. 

The principal defects in classification work at pre-commissioning 
centers were the unavailability, and the lack of knowledge of quali- 
fications of key members of the crew, who were usually sent to the 
yard where the ship was being built rather than to the pre-commis- 
sioning center; lack of specific complement and billet data required 
1n order to assign men properly; and inadequacy of time permitted 
for classification and assignment of the crew which precluded the 
“pooling” of men with special abilities and qualifications. 

CLASSIFICATION AT RECEIVING STATIONS. At one time or another 
nearly every enlisted man in the Navy is ordered, in transient status, 
to a receiving station for assignment to a new ship or station. In 
order to assist in the evaluation of such men’s qualifications, classifi- 
cation centers were established at virtually all continental receiving 
stations and at the Receiving Station, Pearl Harbor. The majority of 
men processed at receiving stations were assigned their next duty by 
the personnel office of the Commander, Service Forces, Atlantic 
Fleet; Commander, Service Forces, Pacific Fleet; and Commander, 
Western Sea Frontier. Accordingly, all men processed by classifica- 
tion centers whose ultimate assignment was controlled by the per- 
sonnel office of the Fleet Service Forces, were reported on availability 


lists or cards to these offices. These lists or cards contained not only 
, and pay grade, but also a brief summary 
ard concerning the man's civilian 
, and a duty recommendation. 


the man’s name, rating. 
taken from the Qualifications С 


and Navy experience and training : n à 
In determining duty recommendations, the classification inter- 
о 


viewers used the techniques and methods previously described, in- 
cluding, when necessary, testing, interviewing, and completion of 
records. . 

Receiving stations processed not only men going to sea for the 
first time but also sea-experienced men returning to the United 
States for leave and reassignment. The latter group constituted the 
largest Single category of men processed by receiving stations and 
required a slightly different type of emphasis from that at other 
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activities. Billets were analyzed and interviewing aids developed 
to give interviewers a better understanding of the various jobs an 
formed aboard ship. As a culmination of this emphasis, a Manua 
of Enlisted Navy Job Classifications was developed and published in 
October of 1945. Although too late to be of value during the war, 
this manual in preliminary form was used to good advantage = 
reporting men's qualifications and in reflecting the replacement re- 
quirements of ships. - p 

Another function of classification centers at receiving stations was 
to contact ships in the general area served by the center in order 
to offer classification services similar to those at pre-commissiontng 
training centers. Qualifications Cards were completed on all the 
members of the crew, and files were organized. Cross-indexes were 
developed and personnel were trained to maintain the entire вреба 
Operating ships were also assisted in stating their personnel require 
ments in the form of replacement schedules. These were sent to 
the personnel offices of the Fleet Service Forces for use in detailing 
personnel. | | | = 

The latter function was comparatively untried, since it involvec 
use of the preliminary job classification titles and codes, but 
proved effective in improving detailing and in achieving proper use 
of classification recommendations made on transient personnel. . 

Perhaps the most successful phase of classification at receiving 
stations was that concerned with the processing of men for advanced 
training schools. These men, subject to the assignment control of 
the Bureau of Naval Personnel, were selected by commanding officers 
of ships and stations for advanced training in accordance with quotas 
allocated to all fleet activities. Classification centers screened these 
men in order to determine whether or not they required the training 
to which they had been ordered, or, on the other hand, whether 0 
not they would benefit from such training. It is estimated that sub- 
stantial amounts of time and money were saved by this screening: 
because it was found that many men had been ordered to training 
who were already fully qualified to handle their duties on the latest 
types of equipment, while others were found who were of such 
limited ability that advanced training would have been of little 
value. Another advantage of such screening was that it aided the 
Bureau in determining the level of training to which each тап 
should be ordered. For example, a motor machinist who had worke¢ 
only on gasoline engine repairs would require both basic and ad- 
vanced diesel school training, whereas a motor machinist who hà 
worked on landing craft or small craft diesels would benefit most 
from advanced diesel training. 


The development of an experience code and classification syste? 
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for this school screening program was the first step in the develop- 
ment of the Manual of Navy Job Classifications. This program, more 
than any other, emphasized the wide differences in experience and 
ability among men in the same rating and pay grade, and pointed 
Out the necessity for a system of job classification more detailed 
than was provided by the existing rating structure. 

CLASSIFICATION AT NAVAL DISTRICTS AND SHORE ESTABLISHMENTS. 
To assure maximum effective utilization of enlisted personnel in the 
Navy's wide-spread network of shore establishments, classification 
officers and. enlisted personnel were assigned to all naval districts. 
The officers so assigned were called district personnel classification 
officers and were responsible for both officer and enlisted classifica- 
tion functions. In processing enlisted personnel, these officers made 
Certain that every man coming into a district for assignment to duty 
Was screened either by one of the interviewers assigned to him or by 
the nearest classification center. 

Extensive work was also done to complete Qualifications Cards 
and crossindex files on all shore establishment personnel assigned 
to district activities. This was accomplished by sending squads of 
classification interviewers to process all members of ship’s com- 
pany at each district activity. The personnel officer and several 
assistants were then trained in the use of classification data for 
assignment and reassignment purposes. In order to implement this 
Program at its inception, two large-sized units of interviewers were 
assigned to move from district to district and activity to activity in 
What was known as “The Flying Circus" or “Beach Survey”. After 
this initial coverage of all districts from Boston to Pearl Harbor and 
from Chicago to Panama, district classification officers took over and 
Maintained an active classification program with small units of inter- 
viewers assigned permanently to their staffs. 

District personnel classification officers also acted as the field repre- 
Sentatives of the Enlisted Classification Section of the Bureau of 

aval Personnel. As such, they coordinated classification functions 
at all activities in the district including training centers, pre- 
commissioning centers, service schools, and receiving stations. 

CLASSIFICATION AT SERVICE SCHOOLS. Studies at elementary service 
Schools showed that there was an appreciable amount of attrition 
among recruits assigned to service school training. To remedy this 
Condition, classification interviewers were assigned to counsel and 
advise service school trainees and to assign all graduates to the types 
of duty which would best utilize their skills and abilities. It was 
discovered that much of the attrition was due to disappointment 
with, or lack of interest in, school work on the part of the trainees. 
It was recommended to recruit training commands that in making 
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recommendations greater emphasis be placed on the interest a 
This was an improvement in selection procedures. Many stuig me 
who otherwise might have dropped out, were counseled and asi pne 
to other schools; others were stimulated and encouraged so that they 
found new interest in the school to which they had originally been 
assigned. Classification officers and classification interviewers at serv- 
ice schools, like those at other activities, also screened men fo! 
submarine, motor torpedo boat, and other types of special duty, by 
administering a personal inventory and by determining each mans 
general adaptability for such special programs. | “> 

CLASSIFICATION ABOARD SHIP. Officers and men especially traine¢ 
to perform classification functions were assigned to only a few of the 
larger combatant ships. However, between 1,500 and 2,000 com 
batant and auxiliary vessels, ranging from patrol craft to battleships: 
were contacted and processed by classification centers. The nature of 
this service has already been outlined in the paragraphs describing 
classification procedures at pre-commissioning centers and receiving 
stations. Although it is difficult to evaluate the effectiveness of classi 
fication services provided to ships, it can be said on the basis of 
letters received from and discussion with executive officers and com- 
manding officers, that many ships made practical use of classification 
services in setting up systematic personnel procedures of their own- 
The important point is that many officers who were and will be 
charged with the command of ships and stations have been con- 
vinced through their own experience of the value of a systematic 
personnel procedure for (1) analyzing the job to be done, (2) deter 
mining the qualifications of the men available, and (3) selecting оп 
a scientific basis the man best qualified for the job. 


Records for Enlisted Personnel 


The basic record for all enlisted personnel is the Service Record. 


This contains, in addition to personal history data, the official record 
of the individual from the time he enters the service until he !5 
separated. One copy accompanies the individual wherever he goes: 
a duplicate copy is kept in the Bureau of Naval Personnel. The 
record is kept up-to-date by the addition of new pages whenever 
there is a significant change in the individual's status, e.g. change 
in duty station, advancement in rating, or change in beneficiary: 
The first entries in the Service Record are made by the recruiting 
stations for voluntary recruits and by the induction centers for pet 


sonnel procured through Selective Service. Official documents an 
correspondence are ke 


Pt in a folder inside the cover page of the 
record. 
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In addition to the Service Record, there was prepared for recruits 
during World War II an Enlisted Personnel Qualifications Card on 
which were recorded significant personal data, test scores, record of 
vocational experience, schools attended, billets occupied, statement 
of hobbies and interests, and the classification interviewer's recom- 
mendation for duty assignment. This card could be placed in an 
open file for ready reference or left in the Service Record. The card 
is intended to give a brief concise picture of a man’s qualifications. 
As stated earlier, the card is filled out by a classification interviewer, 
usually at a naval training center or advanced classification center. 


The Impact of Enlisted Classification on 
the Navy Personnel System 


The growing awareness of the value of systematic classification 
and distribution procedures has had its impact on the high levels of 
naval personnel administration. This is evidenced by the fact that 
ап extensive technical program for the classification and distribution 
of personnel for the post-war Navy has been developed and ap- 
proved. An enumeration of the salient features of this program will 
serve to indicate the extent of the impact which classification services 
have made upon naval personnel administration during the war. 
Specifically, it is planned that: 


1. Enlisted classification and detailing functions at all levels of ad- 
ministration will be integrated by selecting and training Regular Navy 
Officers and enlisted personnel specifically for such duty. 

| 2. Within the Bureau of Naval Personnel a small group of officers and 
civilian personnel will be set up in the Enlisted Personnel Activity to 
develop methods, techniques, and procedures designed to maintain and 
Improve the wartime standards of classification performance. 

3. At least one general aptitude test and some form of personal adjust- 
ment inventory will be administered to all volunteers for enlistment at 
recruiting stations. 

4. А complete classification section will be established as an integral 
Part of the personnel department of all recruit training centers to inform, 
test, and interview recruits and assign them to the duty for which they 
are best qualified. 

5. At least one qualified officer or enlisted man will be assigned to each 
Service school to counsel and assign trainees to duty and to arrange for 
the reassignment of school failures. 

6. Qualified officers and men will be assigned to all receiving stations 
and pre-commissioning centers to interview, classify, and recommend 
Proper duty assignments for transient personnel. Such recommendations 
and detailing will be accomplished in accordance with the Manual of 


Navy Job Classifications. 


30 Selection and Classification 


7. Each ship and shore establishment will be provided with assistance 
in organizing and operating a classification and utilization program con- 
sistent with standard Navy policies. 

8. Data which appeared on the Qualifications Card during the war 
will become an integral part of the man’s Service Record. Cross-index 
files will be established to assist in finding an individual with specific 
qualifications, but the Service Record will be the only source of complete 
data for assignment purposes. 

9. A revised basic battery of tests will be administered to all recruits 


and all other regular Navy personnel to serve as a basis for general evalu- 
ation of each man's aptitudes, skills, and abilities. 


CHAPTER IV 
THE PROGRAM FOR TRAINING OFFICER PERSONNEL 


AMERICA'S traditional substitute for military preparedness is Yankee 
Ingenuity. In peaceful times, the personnel of the armed forces is 
only sufficient to furnish a basic pattern for the organization and 
development of the forces which actually fight our wars. At its peak 
Strength during World War II the Navy's officer corps was larger 
than the entire Navy of 1939, and more than 90 per cent of the 
officers held reserve or temporary commissions. Obviously the process 
by which these workers, teachers, technicians, lawyers, students, etc., 
were transformed into naval officers involved a gigantic program of 
selection, classification, and training. To a large extent this program 
itself was planned or improvised and developed by reserve personnel 
under the guidance and direction of officers of the regular establish- 
ment. Implementation of the Navy's policy, “То make effectiveness 
In war the objective of all development and training" called for 
the application of both the specialized knowledge of regular officers 
and the best techniques known to educators and to industrial and 
personnel management. 


Administration of the Training Programs 


Cognizance over the training of both officer and enlisted personnel 
of the Navy is assigned to the Bureau of Naval Personnel! Within 
the Bureau, principal responsibility for administration of the train- 
Ing programs is assigned to the Training Activity. The wartime 
organization of this Activity is briefly outlined below. 


l. The Standards and Curriculum Division was responsible, in collabo- 
ration with field agencies and other agencies within the Navy Depart- 
ment, for determining the training standards required to meet the needs 
of the service; for the development and promulgation of curricula for 
all schools and courses; for research in selection procedures, tests, and 
requirements for ratings; for the development of standardized require- 
ments, tests and procedures, and for the development and supervision of 
field programs to provide off-duty educational opportunities. To accom- 
plish these ends, the Division was organized into sections designated as 

1 Three exceptions may be noted. The Bureau of Medicine and Surgery maintains 
control of its professional technical training functions. Training of aviation personnel 
15 under cognizance of the Aviation Training Division of the Office of the Deputy Chief 
of Naval Operations (Air) Training of personnel assigned to duty with the fleet is 
under the cognizance of the respective Fleet Training Commands, the Bureau of Naval 
Personnel Providing logistic support. 
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Billet Analysis, Curriculum, Training Courses, Test and Research, In- 
structor Training, and Educational Services. А 

2. The Field Administration Division was responsible for the establish- 
ment of training centers and schools as needed; for the development ме 
procurement of the facilities, equipment, and staffs required for t : 
centers and schools; for the continued supervision of the schools an 
other phases of the training programs, and for the administration of the 
physical fitness program. . 

3. The Training Aids Division was responsible for the preparation, 
evaluation, and distribution of devices and materials designed as aids to 
training, and for the administration of a program to insure the effective 
utilization of these materials in the training programs. 

4. The Quality Control Division was assigned responsibility for evalua- 
tion of the naval training programs in terms of the requirements of the 
Operating forces; for review of the effectiveness of the operations of the 
training centers and schools, and of the training programs devised and 


administered by the other divisions of the Training Activity; for liaison 
with operational commands and with the schools. 


Obviously, training had to be coordinated with other activities 
and operations of the Navy. The manning and equipment of пе“ 
ships and stations and the maintenance of the allowed complements 
were basic factors. Predictions of the personnel needs were supplied 
to the Bureau of Naval Personnel by the Chief of Naval Operations: 
Quotas of trainees and Operating personnel, allowances of equip 
ment and operating budgets for the schools were cleared by thc 
Planning and Control Activity. Selection of trainees for the enlisted 
service schools was made by classification officers under Enlisted 


Personnel Activity. Assignment of officers to school staffs was made 
by Officer Personnel Activity. 


Directives originated i 
promulgated via the com 
the training installations 


n the Bureau of Naval Personnel were 
mandants of the Naval Districts in which 
J were located. A director of training W45 
assigned to the staff of each commandant to provide technical advice 


m Supervisory services to the training schools located within thé 
istrict. 


€ complex responsibilities of command at 8: 


the Naval Academy at Annapolis, their assig™ 
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through the special fields of the Post Graduate School. The general 
line course of the Post Graduate School provides a refresher course 
in the theoretical aspects of naval subjects and additional training 
for the responsibilities of a commanding officer. The Naval War 
College offers training for the higher echelons of command. In the 
periods of duty between the school years, the diligent officer may 
avail himself of correspondence courses. To some extent, pursuit of 
Such courses is motivated by the prospect of the examinations which 
the officer must take in order to qualify for promotion to each succes- 
sive higher rank from lieutenant junior grade to captain. 

Obviously, this program is geared to the requirements of the per- 
manent peacetime naval establishment. It is not, nor is it designed 
to be, a program for the maintenance of a reserve. Alongside of it, 
there existed before the war a training program for reserve officers. 
Even as it was set up on paper, this program was inadequate, and 
the paper program was not realized in practice. As the nation came 
to a realization of its immediate need for a strong navy and as war 
became first imminent and then actual, the task of finding and 
training qualified officers became stupendous. 


The solution of the problem lay partly in specialization, partly in 
the development of streamlined and intensive training programs. 
In the emergency, officer personnel were drawn from four principal 
Sources: (a) former naval officers recommissioned in the reserve; (b) 
enlisted men who were given temporary commissions; (c) civilians 
in administrative positions and in technical and scientific positions 
related to the specialized needs of the Navy, and (d) college students. 

Both the variety of the Navy’s requirements for officers and the 
diversity of the educational and experiential backgrounds from which 
the officers were procured dictated the development of several train- 
ing programs. Practically all reserve officers, whether destined for 
general, technical, or specialized service billets, required some form 
of naval indoctrination training. Beyond this indoctrination, there 
Were varied needs for training in technical specialties, for specialized 
types of duty, and for team or group training for different types of 
ships and operational units. There was also a need for preliminary 
training by which qualified younger men could be given general 
preparatory training at the college level. 

The officer training programs can thus be divided into three 
general classes. First, the primary officer schools consisting of the 
V-7 and reserve midshipmen's schools, indoctrination schools and the 
college training programs (Naval Reserve Officer Training Corps 
Units and V-12 Units). Second, advanced officer training schools con- 
sisting of the technical and semi-technical schools and the specialized 
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training programs. Third, the operational training programs рен 
the cognizance of the fleet commands. А brief description of each 
of these types of training follows. 


Primary Officer Training Schools 


V-7 AND THE RESERVE MipsuiPMEN's Scuoors. The first of the 
emergency officer training programs to be developed were the М 
and V-7 programs. V-5 was designed for the training of naval aviation 
cadets. V-7, as originally authorized in June 1940, accepted officer 
candidates between the ages of 19 and 26 years, who had completed 
two years of accredited college work, were unmarried and physically 
qualified for general service in the grade of ensign. These men were 
enlisted as apprentice seamen and given thirty days shipboard tram- 
ing, then appointed midshipmen and put in a reserve midshipmen $ 
school for three months of intensive study in seamanship, communi- 
cations, naval administration, naval engineering, damage control, 
navigation, recognition, and ordnance and gunnery. Upon comple- 
tion of this course, they were commissioned ensigns and assigned 
either to duty or to further instruction. : 

In 1941, requirements for acceptance in this program were raised 
so that a college degree with work in mathematics, and age between 
21 and 28 were required. After Pearl Harbor there were frequent 
changes in the specific requirements; married men werc accepted; 
the educational requirement was reduced to the equivalent of two 
years of college, and to some extent, sea duty was accepted as a? 
equivalent of college work. Enlisted men recommended by their 
commanding officers were accepted. This led to the establishment of 
academic refresher units or pre-midshipmen's schools. As the number 
of trainees and schools increased, a four-weeks "indoctrination 
period at the school locations was substituted for the shipboard 
training. Between July 1940, and the graduation of the last class 
of reserve midshipmen in December 1945, nearly 70,000 midshipmen 
were commissioned ensigns of the Naval Reserve. Seven schools мете 
employed. One trained engineering officers only; two others traine 
both deck and engineering officers; the remaining four trained deck 
officers. 

Waves officer candidates were selected from civilian life and the 
enlisted ranks and received primary training in a women's reserve 
midshipmen's school. The curriculum consisted of basic indoctrin® 
tion training for all candidates. This was followed, for some officers. 


by specialized training in communications or advanced indoctrina 
tion. 
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NAVAL INpocrrinaTIon Scuoors. The indoctrination schools pro- 
vided intensive training of reserve officers who were commissioned 
directly from civil life. Procedures of the offices of naval officer pro- 
curement are described in Chapter П. In most instances, commissions 
were accompanied by orders either to active duty or to “active duty 
under instruction.” Officers ordered directly to active duty were re- 
quired to register for a correspondence course in Navy Regulations. 
Some activities, to which considerable numbers of newly commis- 
sioned officers were assigned for duty, organized part-time indoctrina- 
поп classes. But the normal process was assignment to "active duty 
under instruction” at one of the naval indoctrination schools. These 
schools were established at thirteen different locations and trained 
nearly 60,000 officers. They provided eight weeks of intensive in- 
struction in naval customs and traditions, navigation, ordnance and 
gunnery, seamanship, naval regulations, administration and law, 
communications, and military drill. All of the officers so trained 
were over 21 years of age and either had college degrees or expe- 
rience in their special fields which indicated an equivalent level of 
ability and achievement. 

THE COLLEGE TRAINING Procrams. The V-12 college training pro- 
gram, which became the principal feeder into the reserve midship- 
men’s schools toward the end of the war, was antedated by the V-1 
Program. Students regularly enrolled as freshmen or sophomores in 
colleges and universities were enlisted in the grade of apprentice 
Seaman and permitted to continue their college courses in an inactive 
duty status, At the same time, students in the upper two years of 
college were enlisted under the V-7 program and held in an inactive 
duty status, By this means, a pool of young men of officer candidate 
quality was reserved in college training when the Selective Service 
age was lowered to 18 and deferments of college students became 
increasingly limited. The У-1 program was in effect from March, 
1942, to July 1, 1943, when the V-12 program superseded it. 

, The V-12 program was developed on the basis of a joint declara- 
Чоп of policy on the utilization of colleges by the Secretaries of War 
and Navy. Under this program, young men were selected for college 
training of from two to eight 16-week terms, depending on the type 
Of service for which they were being prepared. Except for the pre- 
medical and pre-dental students, the work of the first two terms 
Was uniform. After the first two terms, the candidates were selected 
for assignment to "upper level specialties" on the basis of quotas of 
the numbers required, and individual preferences, aptitudes, and 
ability as indicated by screening tests. The broad outlines of the 
Curricula were set by a Navy Educational Advisory Council, de- 
Veloped into lists of courses by subject matter specialists acting as 
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consultants, and their work was reviewed by the Navy bureaus p 
offices concerned. The consultants then prepared brief pon rw 
scriptions and the whole plan was reviewed and approve | г Ае 
advisory council. The initial quota of 80,000 на ноне vic Е wee 
from inactive reservists in the У-1, V-5, and V-7 programis, ї E 
Army Enlisted Reserve Corps enrollees who expressed a Dp een 
for naval service, from enlisted men selected on the basis of Gener: 
Classification Test scores and recommendations of their and 
manding officers, and from civilian high school graduates and «o 
students who took a special examination (described in. Chapter 2 
and were selected by district boards within the limits of quotas 
assigned to each state. y" 
V-12 Units were established in 131 colleges, in 73 of the country 5 
76 medical schools, and in 37 dental schools. The men were enlisted 
in the grade of apprentice seaman and assigned to active duty ind 
instruction. Quotas were set up for Marine Corps and Coast Guard 
candidates. Aviation candidates were classed as V-12a, and upon the 
completion of two terms of the V-12 program, were transferred = 
class V-5 and put in aviation training. Candidates for deck omen 
training and general Marine Corps service were transferred to re 
serve midshipmen's schools and Marine Corps schools after four 
terms. Pre-medical and pre-dental students were transferred to the 
professional schools upon completion of five terms. Candidates fot 
Supply Corps and general engincering training were advanced to 
Supply Corps schools and reserve midshipmen's schools after finish- 
ing six terms of the program. Aerology specialists and engineer sp€ 
cialists in the various curricula—naval architecture and marine gm 
gineering, civil, mechanical, electrical power, electrical communica 
tions, electronics, aeronautical engines, aeronautical structures, ant 
physics—were given eight terms and then advanced to reserve mid- 
shipmen's schools. Pre-chaplain candidates were given eight terms 
and then sent to the seminaries of their denominations for two yeats 
or more. After completion of the first two terms, Marine Corps spC 
cialist candidates were given courses arranged by the academ!c 
authorities for six additional terms in the fields of electrical eng’ 
neering, electronics, civil, mechanical, and mining engineering, 10 


preparation for Marine Corps schools in the fields of communica 
tions, engineering, ordnance, and comb. 


NAVAL RESERVE OFFICER TRAINING 
PROGRAM. After the establishment of 
Reserve Officer Training Corps Units i 
as integral components of the V- 
selected for the Naval Reserve 
second term and continued for 


at engineering. 9 
CORPS INTEGRATED IN THE les 
the V-12 program, the Nava 
n 27 colleges were maintain 

12 commands. V-12 students wee 
Officer Training Corps during thé 
five additional terms in one of thre¢ 
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standard curricula: general, engineering, or business administration. 
Upon completion of the Naval Reserve Officer Training Corps cur- 
riculum, graduates were commissioned ensigns of the Naval Reserve 
or second lieutenants of the Marine Corps Reserve. Shortly before 
the end of hostilities, the authorized strength of the Naval Reserve 
Officer Training Corps was increased from 7,200 to 24,000, to be 
reduced to 14,000 onc year after the end of the war; 25 additional 
Naval Reserve Officer Training Corps Units were authorized. 

_ At the same time, liquidation of the У-12 program was planned. 
Enrollment in the V-12 program had been progressively reduced 
beginning in November 1944, so that by November 1, 1945, the en- 
rollment was less than half the original allowance. Concurrently, the 
proportion of students selected from enlisted rather than civilian 
sources was increased. By November 1945, most of the V-12 students 
were transferred to Naval Reserve Officer Training Corps Units or 
were taking naval reserve officer training courses in interim V-12 
Units. Ten of the new Naval Reserve Officer Training Corps Units 
were assigned to institutions which had not had other naval training 
programs. The curricula prescribed for these units are designed for 
the normal four-year college course. In the remaining 42 Naval 
Reserve Officer Training Corps Units, conversion to the four-year 
program was scheduled to become effective in the summer of 1946. 


Advanced Officer Training Schools 


"TEcuNICAL TRAINING Scuoors. In the field of technical training, 
advanced schools were established for officers to be assigned to duty 
as ordnance, communications, damage control, tactical radar and 
fighter director officers; as engineering officers on diesel installations; 
and as officers responsible for the installation and maintenance of 


electronics gear. Diesel, communications, and electronics training 


courses were located in civilian training institutions, both colleges 
and industrial plants. Damage control, ordnance courses, and most 
other technical and semi-technical programs were developed at naval 
Installations. Most of the officers assigned to these schools for instruc- 
tion were recent reserve midshipmen's and indoctrination school 
graduates. A problem that was common to all of the training schools 
Was met in intensified form in the technical schools—the equipment 
available for instructional purposes was neither adequate nor up-to- 
date. When the schools were first established, the curricula were 
developed locally. By September 1943, the curricula were standard- 


ized and equipment and educational aids were provided to imple- 


ment the standardized curricula. 
In addition to the technical training of a pre-service nature pro- 
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vided in these schools, the Post Graduate School of the Naval Acad- 
emy provided advanced technical training for experienced — 
both regular and reserve, in its naval architecture, engineering, orad- 
nance, communications, radio, law, and staff and command courses. 
SPECIALIZED TRAINING Courses. Specialized training courses were 
established to meet the Navy’s needs for experts in various fields of 
specialized service. Among the continuing specialized programs were 
those for oriental languages, military government, chemical warfare, 
and naval justice. Temporary programs were set up from time to 
time for specific needs, such as the indoctrination of officers procured 
from the ranks of secondary school and college teachers and ad- 
ministrators to serve as commanding officers of the V-12 Units. 
The oriental language program furnishes an outstanding example 
of the development of such courses. The outbreak of the war found 
the country with a conspicuous dearth of men qualified as translators 
and interpreters of Japanese. A few naval officers had received train- 
ing in Japanese at the University of Tokyo over a period of nearly 
twenty years, but of the 60-odd who had taken the 3-year course, only 
about a dozen were regarded as fully proficient. To meet this need, 
two schools were set up. Adapting the system of instruction which 
had been employed at Tokyo, the course was compressed and inten- 
sified to a l-year program. Only men with outstanding linguistic 
ability and Phi Beta Kappa caliber in general ability were selected 
for this training. Originally both civilian and service personnel were 
enrolled, but later selections were made only from officers who ap- 
plied for the training, or civilian applicants were commissioned and 
assigned to the schools on a “duty under instruction" basis. In June 
1944, courses in Malay, Chinese, and Russian were established. 


Operational Training 


. The types of training described thus far were designed largely (0 
increase the individual officer's knowledge and understanding of the 
Navy and of the special field in which he was to be assigned to duty: 
But an effective operational unit requires coordination and team- 
work, the development of techniques and routines. Early in the war 
the need for activities which would build up such teamwork led (0 
a mushroom growth throughout the Navy of training programs in- 
tended to overcome the locally discovered deficiencies. The appar 
ent deficiencies resulted both from the relative inexperience of 
officers and men and from the development of new instruments: 
methods, and doctrine. Originally created without central control 
or direction, programs of this kind were gradually integrated int? 
better planned activities partially under the Bureau of Naval Per- 
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sonnel, partially under the Fleet Operational Training Commands. 

The key factor in operational training is the development of 
efficient team action in the performance of tasks which require varied 
rather than uniform activities on the part of individuals making up 
the operational unit. Generally, such efficiency is dependent upon 
thorough understanding of the unit's task and of the individual's 
function in the organization, upon the competence of each indi- 
vidual in his job, and upon habitually correct reaction to the prob- 
lem situations occurring. In operational training, therefore, the 
trainees are organized into groups that work together, a gun crew, 
à repair party, or a combat information center team. Here newly 
commissioned officers may experience their first command contact 
with enlisted men and their first responsibility for successful com- 
pletion of a task. Particularly in the pre-commissioning schools, they 
learned in practical and realistic terms, under the compelling motive 
of having immediate need to use all they could learn, the functions 
and responsibilities of the billets to which they were assigned. 

Approximately fifty different kinds of operational training schools 
were set up. The following list is only illustrative of the variety: 
Advanced Base Supply Training, Advanced Base Aircraft Carrier 
Gasoline Systems, Amphibious Training, Armed Guard, Combat 
Information Center, Team Training, Harbor Defense, Mine Dis- 
posal, Submarine School, Destroyer School, Salvage, Wartime Mer- 
chant Ship Communications. 


Post-War Training Plans 


The program of officer training for the post-war Navy depends 
upon the action of Congress. Plans currently under consideration 
Propose to broaden the basis for selection of officer candidates and 
officers, Under legislation now in effect, college graduates with Naval 
Reserve Officer Training Corps training are eligible to transfer to 
the regular Navy after a period of active duty and examination. 

he allowed peacetime enrollment in the 52 authorized Naval 
Reserve Officer Training Corps units is 14,000 men, which should 
Produce between 2,500 and 3,000 graduates per year. The amount 
of training in Naval Science subjects which will be required in 
these units has not been determined and may depend to some extent 
Upon the provisions made for financing the program. It is also pro- 
Posed that graduates of accredited four-year colleges without Naval 
eserve Officer Training Corps training be made eligible for com- 


missions as officers in the Reserve with similar privileges of appoint- 
ment to the regular Navy after experience and examination. 
These plans are formulated in terms of supplying the needs for 
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officers of the projected post-war Navy. As this is being written, 
plans for maintaining a progressive training program for reserve 
officers are less well developed. Should the need arise for maximum 
expansion of the Navy, it is to be expected that many of the expe- 
dients adopted during World War II will again prove useful, and 
further that facilities, personnel, and equipment for officer training 
programs will be recognized as needs equally urgent with the need 
for new ships. The experience of World War II has proven con- 
clusively that the complex gear aboard modern fighting ships can 


be used effectively only by highly trained men under competent 
officers. 


CHAPTER V 


THE PROGRAM FOR TRAINING 
ENLISTED PERSONNEL 


During the war the Navy found it necessary to man its enlisted 
billets predominantly by civilians who had neither experience in 
nor training for the military and highly technical work which had to 
be performed aboard ship and at shore stations. Training these indi- 
viduals for their jobs became one of the most critical undertakings 
of the Navy. Production of trained personnel needed to keep pace 
With construction of new ships and aircraft. Consequently, personnel 
had to be trained by the hundreds of thousands in relatively short 
but highly intensified training programs. Then, too, as the war 
Progressed, under the impact of new inventions and improvement 
in fighting equipment, skills and knowledge already acquired 
through training frequently became obsolete. Under these circum- 
Stances, the Navy training program was subject not only to tremen- 
dous expansion, but also to continuous revision, both in terms of 
length and content of specific courses, and with respect to the num- 
ber of personnel in various training programs. 


Scope of the Enlisted Training Program 


The structure of the training program for enlisted personnel had 
already been established before the outbreak of the war. It involved: 


l. an introductory period of basic training for recruits (given in Naval 

raining Stations prior to May 1944, thereafter in Recruit Training 
Commands in Naval Training Centers); . 

2. a system of Naval Training Schools to which selected. personnel 
Were assigned for elementary and advanced technical training in the 
Various enlisted specialties which are distributed among eight branches of 
Service: Seaman, Artificer, Artificer-Engine Room Force, Aviation, Special, 

ommissary, Specialist, and Steward; . | 

3. in-service training programs for advancement of personnel in their 
Specialties. 


This Structure of training was adapted to wartime needs by ex- 
Panding the Navy school system, by accelerating training in all its 
aspects, and by developing special programs to meet new demands 
and temporary needs. During the period from 1939 to 1945, ap- 
Proximately 4,000,000 enlisted men and women were trained in one 


Ог more of these programs. 
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Specialization, and Promotion of Enlisted Personnel 


Two principal motivating factors behind Navy training have been 
(1) a system of rates (or ranks) which enabled personnel who had 
acquired technical training in a specialty to be promoted or ad- 
vanced on the basis of increased proficiency, and (2) a scale providing 
for substantial increases in the base pay of personnel upon their 
advancement from one rate or pay grade to another. 


Taste l-v. Base Pay for Navy Rates 


RATE BASE PAY PER MONTH * 
Apprentice Seaman $50.00 
Seaman or Fireman, second class 54.00 
Seaman or Fireman, first class 66.00 
Petty Officer, third class 78.00 
Petty Officer, second class 96.00 
Petty Officer, first class 114.00 
Chief Petty Officer. (acting) 126.00 
Chief Petty Officer (permanent) 138.00 


* These rates prevailed on August 15, 1916. 


As shown in Table l-v, this structure enables individuals to ad- 
vance through a series of steps from Apprentice Seaman, the level 
at which practically all enlisted personnel enter the Navy, to Chief 
Petty Officer, a rate which is attained by a relatively small per cent 
of men. Since increased technical or special skills are required for 
each advancement in rate, and consequent increase in base pay, most 
personnel are motivated to obtain the training which would help 
them qualify for advancement. This training is obtained in Navy 


schools and in local apprenticeship programs aboard ship and at 
shore stations. 


Training Schools 


Training schools of three different types were maintained to 
supply personnel for both general and technical duties ashore and 
afloat. The first of these were the establishments for recruit training, 
to which all new personnel were assigned upon enlistment or in- 
duction, to acquaint them with the general duties of enlisted naval 
personnel. Training of the second t 
to those individuals who ( 
appeared to be best quali 
the many enlisted special 
training, of an operation 
whose duties would invol 


уре was given in service schools 
in terms of scores on basic battery tests) 
fied for technical training in some one of 
ties. A third and more advanced type of 
al character, was provided for personnel 
ve working in a team or group. 
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Recruir TRAINING. Upon entering naval service, newly enlisted 
or inducted personnel were first ordered as apprentice seamen to 
active duty for a period of recruit training. During the war this 
training program varied in length from three to twelve weeks and 
was given in one of seven naval training stations or recruit training 
commands. In contrast to later training, the instruction on the 
recruit level was less technical and was concerned in the main with 
giving recruits an overall view of the Navy, its mission, its opera- 
tions, and the manner in which each individual was expected to 
contribute toward the accomplishment of that mission. Instruction 
Was given in elementary seamanship, fire fighting, first aid and per- 
sonal hygiene, military drill, physical conditioning and swimming, 
lookout-recognition, gas warfare defense, use of sound-powered tele- 
Phones, and ordnance and gunnery. 

During the early part of his recruit training, each individual was 
tested with the Basic Test Battery of classification tests (see Chapter 
III for a complete description of the classification program). Per- 
formance on these tests was motivated by informing the recruits of 
the types of billets to which they might be assigned, and by explain- 
ing that specific assignments would be conditioned in part by special 
abilities and aptitudes indicated by test scores. A few days after the 
administration of the tests, an interview was scheduled in which the 
interviewer obtained relevant information regarding civilian work 
experience, education, and interests of each individual. Such infor- 
mation was used along with test scores in determining whether the 
individual should, upon the completion of recruit training, be 
recommended for general detail aboard ship or at a shore station or 
whether he could be of most service to the Navy if given specialized 
technical training for one of the highly technical jobs. Assignments 
Were based upon the recommendations of the interviewers and upon 
changing needs for distributing the Navy's manpower. 

Recruit personnel were advanced automatically to seaman or fire- 
man, second class, at the end of basic training. Thereafter, advance- 
Ments within an enlisted specialty were made individually in ac- 
cordance with requirements in each general service rate. If assigned 
to general duty, the recruit was encouraged to select an enlisted 
Specialty and to obtain in-service training which would help him 
advance in his rating. If assigned to an elementary service school. the 
training received there would enable the recruit to qualify more 
rapidly for advancement in rating upon his assignment to a billet. 

Standardized written achievement examinations produced in the 
Test and Research Section were administered routinely to all re- 
cruits at the completion of their training. (See Chapters XIV and XV). 


Since these examinations were based on the informational content 
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of the curriculum, trends in test results were used as criteria in 
evaluating the effectiveness of instruction in the recruit training 
program. e 
ELEMENTARY SERVICE ScHooLs. Two types of elementary service 
schools were maintained to provide training on a pre-rating level 
for quotas of qualified trainees drawn from the recruit population. 
These were “P” schools and “A” schools. PR 
"P" schools were maintained (1) to provide short-course training 
in elementary operating skills needed by personnel who were to be 
assigned to certain basic types of duty, and (2) to provide training 
which would prepare selected personnel for a somewhat more ad- 
vanced type of technical training in "A" schools. The period of 
instruction in "P" schools varied from three to eight weeks. Grad- 
uates of these schools were either assigned to further training or to 
duty in the enlisted specialty for which they were trained. . 
"A" schools were maintained to provide the elementary technical 
training needed by third class petty officers in various specialties. 
The period of instruction in "A" schools varied from six to twenty 
weeks. In general, however, training in most “А” schools lasted for 
sixteen weeks. In the carlier months of the war, a certain percentage 
of the best qualified graduates of “А” schools were advanced to third 
class petty officer ratings at the end of their training. The remainder 
were graduated as non-rated seamen or firemen, first or second class; 
and given designators to facilitate their assignment to the duty for 
which they were trained. While the practice of rating graduates ol 
"A" schools was later discontinued, their advancement in rate was 
more likely to follow in duty billets as a result of the specialized 
training obtained. 
The Test and Research Section was responsible during the war 
for constructing standardized achievement examinations and per- 
formance tests for use in both “A” and “Р” schools. A description 


of examinations and outcomes of testing in these schools will be 
found in Chapter XV. 


ADVANCED SERVICE Scuoors. Included 
“В” and “С” schools. While both of these types of schools drew 


trainees from the same sources, namely, elementary schools, shore 
centers, and the fleet, their curricula differed widely. 

The curricula of “В” schools were designed to prepare trainees 
to meet the technical qualifications required for a general service 


rate of first class petty officer. Trainees assigned to these schools were 
second and third class petty officers and th i i 


in this classification ате 


schools were those f 
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"C" schools were designated by type as "C-1" schools, located in 
naval training centers, and ''C-2" schools, operating in manufactur- 
ing plants and factories. Their curricula were designed to provide 
training in the development of special skills and knowledge required 
in specific types of duty in general service ratings or in maintaining 
and operating new equipment. For example, among the "Cl" 
schools maintained during the war were those for training printers, 
typewriter repairmen, and motion picture operators. There were 

C-2" schools for such training as that needed by teletype mainte- 
nancemen, diesel instructors, and aircraft instrument repairmen. 

FLEET SERVICE ScHOOLS AND FLEET ScHooLs. Both of these types 
of Schools were maintained to supply the fleet with personnel 
equipped with special abilities needed only in shipboard billets. 
Curricula were therefore shaped in nature and scope to meet spe- 
cialized manpower needs of the fleet. For example, among the ele- 
mentary and advanced types of training provided in these schools 
Was that needed by landing craft operators, ammunition handlers, 
welders, communications technicians, and aircraft maintenancemen. 
The main difference between these two types of schools was one of 
administrative control. While Fleet Service Schools were operated 
for the fleet by the Bureau of Naval Personnel, all Fleet Schools 
were under the cognizance of Fleet Training Commands. 

OPERATIONAL TRAINING. Operational schools were maintained for 
the purpose of providing team training for groups. Personnel in 
operational training often included both officers and enlisted men 
who were assigned to this training from the fleet, from recruit train- 
mg, or from Navy schools. These trainees were organized for instruc- 
tional purposes into tactical units similar to later organizations of 
units ashore or aboard ship. For example, this type of training was 
Siven the nucleus crews of new construction. Instructional emphasis 
was placed in operational training on the development and coordina- 
tion of skills needed in operating such shipboard equipment as that 
used by groups in fire fighting, salvaging and repair, handling am- 


munition, and in bomb disposal. 


Training for Advancement in Rate 


Training in Navy schools and local apprenticeship programs of 
training for advancement in rate were maintained to supply skilled 
personnel for petty officer ratings. While training in a Navy school 
did not in itself qualify an individual for advancement to petty 
officer status, the training he received there usually enabled him to 
meet the requirements for advancement soon after he had been 
assigned to a billet in his specialty. But all personnel, regardless of 
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previous training or the lack of it, were eligible paf pore Ape 
advancement. This training could be obtained in each activ ur 

afloat by "striking" for the next higher rate in an enlisted rating 
and learning while working in an assigned duty billet. Ри 

In general, а non-rated man or a petty officer became eligible . | 
advancement to the next higher rate in his specialty when he p 
(1) spent a specified length of time in his present rate or billet; e) 
completed a Navy training course prescribed for the specialty an 
the rate for which he was "striking", (3) attained at least the mini- 
mum marks specified in proficiency and personal conduct, (1) дет. 
onstrated proficiency in the technical skills of the rate for which br 
was "striking", and (5) passed a technical examination based on =e 
training course issued for his study. Advancement within enlistec 
specialties to petty officer status was therefore contingent ime 
meeting requirements which pertained to the training, length. i" 
service, and personal attributes of personnel. Since these require- 
ments were prescribed by the Bureau of Naval Personnel, eq 
in training for advancement were uniform in naval activities, anc 
relatively high standards of proficiency were maintained. - 

Programs of training for advancement in rate were organizec 
along similar lines in most activities. A training officer was placed 
in charge of the local program. Responsibilities for supervising the 
progress of personnel in training were delegated to division officers 
and within divisions, to senior petty officers. 

In conducting a local in-service training program for advancement 
in rate, general procedures were as follows: 
quainted with the rates to which they were 
with the specific requirements for advancem 
manuals were issued by training officers, (3) 


vided for personnel to qualify in the practical phases of the work 
involved, (4) progress tests were administered either at the end o! 
a training course or from time to time during the course as a means 
of determining how well prepared trainees were, (5) a final technical 
examination was prepared by an examining board and administered 
in order to determine the technical competence of personnel who 
had completed a training course, and (6) those who passed the final 
examination to the satisfaction of the examining board were recom 


mended by the commanding officer for advancement to the next 
higher rate. 


(1) personnel were ас 
eligible to advance and 
ent, (2) training course 
opportunities were pro 


Special Training Programs 


In addition to the major types of training described in the pre 
ceding section, programs of lesser Scope were organized to meet 


~ 
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special needs for limited periods of time. The more important of 
these special training programs included (1) Women's Reserve 
Training, (2) Refresher Training, (3) Organized Shipboard Train- 
ing, (4) the Retraining and Disciplinary Program, and (5) the Special 
Recruit Training Program. 

Women’s RESERVE TRAINING. Since WAVES were procured to re- 
place men in shore billets, the program of training enlisted women 
was similar to that of enlisted men. Following a period of six weeks 
in recruit training, waves personnel were assigned, depending on 
their qualifications, to general duty or to special training. 

Special training programs in Navy schools were maintained for 
enlisted women to prepare them for duty as yeomen, storekeepers, 
mailmen, gunnery trainer instructors, hospital corpsmen, and for 
certain aviation and radio ratings. If assigned to general detail, 
WAVES personnel could advance in any of the ratings open to women 
by "striking" for a given rating and qualifying for each advancement. 

REFRESHER TRAINING. Programs of refresher training were de- 
signed specifically to meet the temporary training needs of a ship's 
crew while the ship was in port and waiting for repairs, fuel, or 
supplies. Curricula were necessarily flexible since they had to be 
adapted to the length of time available for training. Instruction was 
given in both elementary and technical subjects. Thus, refresher 
training was given to maintain or increase skills which might other- 
wise have deteriorated over periods of inactivity. 

ORGANIZED SHIPBOARD TRAINING. Shipboard training had as its 
at of the individual as well as group per- 
An officer on each ship was assigned to 
ng included organized programs of 
d training for advancement in 


purpose the improvemer 
formance of personnel. 
administer the program; trainit 
team training, refresher training, an 
rate, 

RETRAINING AND DISCIPLINARY PROGRAM. The retraining and disci- 
plinary program during the war was organized as a means of restor- 


ing offenders of military law to naval duty or, if discharged, to 


rehabilitate them for civilian living. To this end, a constructive 


retraining and vocational training program was maintained for 
prisoners who had been sentenced to varying periods of confinement 
by general courts martial. . . 

Each prisoner was first placed in quarantine for a period of a few 
days. During this time, he was interviewed and various psychological 
and educational tests were administered. The offender was then 
brought before an assignment board which in the light of his mental, 
moral, and health status, recommended his assignment during con- 
finement to some type of vocational training. 

Vocational training occupied the major portion of a prisoner's 
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period of confinement. It involved work programs in nad sten 
items of naval equipment were produced or in which equipmer 
was salvaged and repaired. | о 

While vocational training was given all military offenders under 
sentence by a general court martial, the retraining program ye 
designed specifically to help personnel rcadjust to the demands E 
active naval duty. Accordingly, prisoners who were to be returnec 
to duty were assigned from vocational training to ten weeks' re- 
waining immediately preceding their release from confinement. - 

Upon assignment to the retraining program, personnel parade 
pated in physical training and military drill, and were given a те 
fresher course in naval orientation. In addition, training in an 
enlisted specialty was provided in basic seamanship, gunnery, — 
munications, pre-engineering, or in yeomen, steward's mate, and 
ship's cooks and baker ratings. - 

ЗРЕСТАТ, Recruir TRAINING Procram. Beginning in June 1943, 1t 
became necessary to accept illiterates for naval service. These illit 
erates should not be confused with men rejected from service for 
reasons of low mentality. They included non-English speaking in- 
ductees as well as men who for certain environmental reasons lacked 
basic skills in reading, writing, and arithmetic. Technically, ап, 
English speaking illiterate was one who had at least sufficient intelli- 
gence to be useful in the service, but was below a fourth grade level 
of proficiency in reading, writing, and arithmetic skills. 

It was obvious that optimum use could not be made of these 
individuals until they had developed at least minimum proficiency 
in reading, writing, and use of numbers. It was equally obvious 
that the existing recruit training program was not adequate for the 
needs of these illiterates. Consequently, a special training program 
of 14-weeks’ duration was organized for these handicapped recruits: 
While the most important single objective in this special training 
program was that of providing literacy training, provision was also 
made for military and physical training, and for instruction in ele 
mentary seamanship and related topics. 

It was necessary to organize each company for instructional pur 
poses into three groups. The first group included the totally illit- 
crate. The second group was made up of men who approached a 
fourth-grade level of skills in reading, writing, and arithmetic. The 
third group consisted of non-English speaking trainees. Initial classi- 
fication of trainees into these three groups was made on the basis 
of performance on the Navy Literacy Test, the Navy Non-Verbal 
Classification Test, (see Chapter VI) and the Special Training 
Writing Test. 


Instructors, who for the most part had been teachers in civilian 
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life, were carefully chosen and given in-service training in handling 
special problems which were likely to arise in this program. It was 
important, for example, to correlate instruction in reading, writing, 
and arithmetic with military and physical training and with seaman- 
ship. Instruction had to be adapted to the language and comprehen- 
sion level of trainees. Emphasis upon learning by doing was made 
through wide use of visual aids, demonstrations, and classroom dis- 
cussions. 

Standardized forms of achievement examinations in reading were 
produced in the Test and Research Section for use in this special 
training program. These examinations were used along with the 
progress tests and other achievement examination materials to eval- 
uate the instructional outcomes of special training. 


Post-War Training 


Plans for the post-war training of enlisted personnel are still in 
the process of being developed. To a large extent, these plans must 
await action of Congress on the size of the Navy. In the main, how- 
ever, no large scale reorganization of enlisted training is anticipated. 
, The basic pattern of recruit training, followed by technical train- 
ing in Class “А”, “В”, and “С” schools, will continue in the post-war 
training program. In addition, it is tentatively planned that quali- 
fied recruits will be sent to primary schools for an initial period of 
Seneral technical training prior to shipboard assignment. Following 
à tour of sea duty, selected personnel will be assigned to Class "A" 
Schools for training in the various specialties. Advanced technical 
training will continue to be maintained in the Class "B" and "C" 
Schools. Finally, training programs for advancement in rate will 
continue to serve all enlisted personnel who are striking for ratings 


Within their specialties. 


PART II 


THE CONSTRUCTION, STANDARDIZATION, AND USE OF 
SELECTION AND CLASSIFICATION TESTS 


CHAPTER VI 
BASIC TESTS FOR ENLISTED PERSONNEL 


Ix 1942 a battery of mental tests which had been in use for several 
years was employed in most of the recruit training programs of the 
United States Navy for the purpose of classifying enlisted personnel. 
Che battery consisted of the following tests: 


У l. O'Rourke General Classification Test—Junior Grade (U. S. Navy 
Edition), 

2. Mechanical Aptitude Test—Junior Grade ( 
Standard Test in Arithmetic. 
Standard Test in Spelling. 
Standard Test in English. 
Radio Code Aptitude Test. 


U. S. Navy Edition). 


D оњ оо 


These six tests were used to classify recruits as to their aptitudes for 


Specialized training in naval training schools. А 
_ Extended study of these tests led to the conclusion that they failed 
in several respects to fulfill their functions adequately. Studies were 
initiated in 1942 to determine the values and weaknesses of the tests 
and to appraise the procedures used in their administration and 
Scoring? At the same time the decision was made to proceed with 
the construction of a new battery of tests. Ка 
А Study of the accuracy of scoring the tests at four naval training 
Centers showed that large errors were commonly made, some great 
cough to render the test scores valueless for selection purposes. 
teps were taken to eliminate the major sources of error by devising 
а new standardized scoring procedure which was strongly recom- 


mendedg Find 
to all training centers. А 
qo» lidity of the old basic test 


he results of the studies of the va : 6 А 
attery for predicting success in service schools fully confirmed the 
Carlier judgment ас new tests were desirable. For example, a study 


Was made of the validity of the old tests in six different service 
Schools at a large naval installation. It was found that the correlation 
coefficients between test scores and service school grades were so 
OW that the tests were of questionable utility. A study of an ехрегі- 
menta] battery of tests at three advanced service schools showed that 
‘he most valid of the experimental tests contained items similar in 
‘ype to those in the proposed new test battery. Another analysis of 
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Book 4. Mechanical Knowledge ‘Test (Mechanical and Electrical 
Scores). 
The special aptitude tests were issued as follows: 


Book 1. Clerical Aptitude Test and Spelling Test. 
Record Album. Radio Code Test—Speed of Response. 


The Fleet Edition was issued in three booklets as follows: 


Book 1. Electrical Knowledge Test, Mechanical Knowledge ‘Test 
(minus verbal items), General Classification Test (minus op 
posites items). ре 

Book 2. Mechanical Aptitude Test and Arithmetical Reasoning Test- 

Book 3. Clerical Aptitude Test. 


General Tests 
GENERAL CLASSIFICATION Trsr. The General Classification Test 
was set up to include only items involving verbal ability. Three type 
of item were included: Sentence Completion, Opposites, and Analo- 
gies, in order to require thought and reflection of the awe 
rather than vocabulary or special information exclusively. Such 
items usually form a test of high reliability. 


У We a А „пега! 
Illustrations of the three types of item included in the Gene 
Classification Test follow: 


Sentence Completion 
A good sailor will ........ the orders of his superior officers. 
(1) see (2) fear (3) read (4) obey (5) like 
Opposites 
GRIEF 
(1) anger (2) poverty (3) joy (4) sorrow (5) pride 
Analogies 
WATER is to sponge as INK is to ........ 
(1) pen (2) bottle — (3) write (4) blotter (5) desk 


Reapinc Tzsr. The Reading Test consists of six paragraphs of 
increasing difficulty, each followed by several questions. The ques 
tions were designed to measure the ability to note details in the 
material read, to draw inferences from it, and to follow directioD* 
The paragraphs all consist of material related to Navy life. 
following is an example of the type of item used in this test: 


After a can of paint has been opened and the paint partly used, 
the can should be covered and kept as airtight as possible to pre 


~ 


Enlisted Personnel 


vent a paint scum from forming on the surface. If scum forms, 
the paint should be strained through a fine-mesh wire screen or 
cheesecloth. 


To prevent scum from forming in a partly-used can of paint, 
one should 


(a) keep the can free from dirt. 

(b) fill the can up with water. 

(c) stir the paint well before storing. 

(4) keep the can tightly covered. 

(c) make sure that the can is more than half full. 


The method of removing scum from paint is 


(a) to stir the paint thoroughly. 

(b) to pour the scum off. . 

(c) to strain the paint through a wire screen. 
(d) to skim the scum off with a putty knife. 

(c) not discussed in this paragraph. 


The method of thinning paint is 


(a) to mix it with turpentine. 

(b) to mix it with linseed oil. 

(c) to mix it with white lead. 

(d) to mix it with water. 

(e) not discussed in this paragraph. 


ARITHMETICAL REASONING Тет. The Arithmetical Reasoning Test 
Consists of verbally stated problems which involve ability in quanti- 
tative thinking. It was attempted to make the statement of each 
Problem sufficiently simple that reading comprehension would not 

* an important factor. The actual reading time was intended to 
consume only a small portion of the testing time. The problems were 
chosen 50 that they could be solved by arithmetic, with the computa- 
попа! processes simple enough to require only a small part of the 
testing time. In other words, the items were chosen and stated so 
that more than half of the testing time would be devoted to deter- 
mining the method of solution. The following illustrates the type 
ОЁ item used: 


During World War I, keels were laid at Hog Island at the rate 
of one every five days. At that rate, how many keels were laid in 
5 days? 
(à) 51 бб (975 (020 (91575 


. MECHANICAL Aprirupe Test. The Mechanical Aptitude Test con- 
Sists of three sections: Block Counting, Mechanical Comprehension, 
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and Surface Development. All three types of items involve the ability 
to perceive visually the mechanical details of a situation which is 
shown pictorially or graphically, to follow directions, and, in the 
case of Mechanical Comprehension, to apply to the solution of the 
problem the physical principle which governs the situation. The 
spatial abilities involved in Block Counting and Surface Develop- 
ment, in addition to being heavily involved in mechanical aptitude, 
were considered important in billets in which men would be re- 
quired to read drawings and blueprints, or to work on patterns. 

The types of item used in the Mechanical Aptitude Test are as 
follows: 

Block Counting. This test consists of 2 columns of blocks of the 
same size and shape as shown in Figure l-vt. Some of the blocks are 


SAMPLE COLUMN 


Figure 1-ут, Sample block counting item. 


lettered alphabetically. T ci i i 
y. The task is to decid a ks touc 
each of the lettered blocks. MAD MM 


Mechanical Comprehension. 1n th 
а picture which il 


: sides are lettered. Th z 
lines of the pattern with th e task is 
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involves the ability to perceive the relationships involved in trans- 
forming from a two-dimensional projection to three dimensions as 
shown in perspective. An illustrative item is shown in Figure 3-vr. 

MECHANICAL KNOWLEDGE Test. This test contains items of electri- 
cal and mechanical knowledge. Part I, called Tool Relationships, con- 
Sists of pictorial items of which 25 are electrical and 35 are me- 
chanical, Part II of this test contains 80 information items, each 


CTT LL LLL LLL LLL 


At which point should one pull 
down to raise the weight more 
easily? 
(1) One should pull down at 
point A. 
(2) One should pull down at 
point B. 
(3) The weight may be raised 
just as easily from either 
point A or point B. 


Figure 2-vi. Sample mechanical comprehension item. 


SIDE (x) IN THE PICTURE IS MARKED IN THE PATTERN. 


L IN 


PATTERN PICTURE 


Figure 3-vi. Sample surface development пет. 


2 


Stated in verbal form as a question with which four alternative an- 

Swers are given. The task is to indicate the correct answer. Two pic- 

torial items are shown in Figure 4-vi, Sample A being electrical and 

a слаліся, Below each illustration is ап electrical and a mechan- 
al information item. 


Special Tests 


" Three special aptitude tests were added to the general tests to 
omplete the battery. These were a Clerical Aptitude Test, a Spelling 
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Test, and a Radio Code Test—Speed of Response.* These tests ei 
designed to measure special aptitudes considered important for su 
cess in several types of training schools. | 
CLERICAL APTITUDE TEST. This test consists of three parts: Apoa 
betizing, Name Checking, and Number Checking. Aptitude along 
these lines would appear to be required in storekeeper or yeoman 
billets. u —" 
Alphabetizing. This subtest measures the ability to arrange "m ^ 
in alphabetical order. Each item consists of five words, four of № ae 
are given in alphabetical order. The fifth, the key word, is to be 


Pictorial Item (Electrical). 


a] | в! е 


| | 
— i z d = 


Electrical Information Item. 
In an a-c operated radio receiver direct current is needed for the 
(a) rectifiers (b) plate voltage (с) power pack (d) field coils 


Pictorial Item (Mechanical). 


c 
A b 
2 РА 
ОЈ | 
WHICH WRENCH COULD. | 
BE USED WITH ALL THESE. Ч 
NUTS? 4 БР 


Mechanical Information Пет, 
A rasp is a kind of 
(a) saw (b) wrench (c) Ме (d) hammer. 


Figure 4-vi. 


inserted into the correct position so that all five will be in alph* 
betical order, 


Sample tool relationship items. 


: е5 
і i o nam 
which are either id › consists of tw 


mm . tate 
У similar. The task is to $ 
whether the two names in each pai 
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differences between members of a pair of names might involve one 
letter of a name, a change in punctuation, or a grosser and more 
perceptible difference. The following items illustrate this subtest: 


l. J. H. Hornblow & Co.—J. Н. Hornaday & Со. 

2. American Outdoor Adv'g.—American Outdoor Adv'g. 
3. National Life Ins.—National Life Ins 

4. Colgates’ Dental Cream—Colgates Dental Cream 


Number Checking. Each item in this subtest consists of two num- 
bers of from five to eleven digits each. The task is to indicate whether 
the two numbers in each item are the same or different. The fol- 
lowing are sample items: 


1. 436815———435815 
2. 9614328———9614398 


SPELLING Txsr. Each item of this test consists of five words, one of 
which is misspelled. The task is to indicate the misspelled word, as 
m the following list: 


(1) literature (2) accomadate (3) matrimonial (4) prerogative 

(5) ellipse 

RADIO Cope Trsr—Sperp or Response. This test, designed to 
measure aptitude for code learning, is described in Chapter VIII. 


Uses of Basic Test Battery 


А Тһе primary use of the Basic Test Battery has been for classifica- 
ton of enlisted men for Navy training schools. The tests have been 
administered to all recruits at naval training centers. On the basis of 
test scores and other considerations, the decision has been made as 
to whether or not an individual should be recommended to a school 
for special technical training. 

Each test of the battery has demonstrated its usefulness in this 
selection process, but some of the tests have been more effective than 
Others in selecting men for a specific type of school. For example, 
for basic engineering and electrical schools, where the curricula 
require a good deal of mathematical work, the Arithmetical Reason- 
Ing Test has been most effective in predicting success. For diesel, 
torpedoman, and machinist's mate schools, the tests of mechanical 
aptitude and mechanical knowledge have been most valid. Cutting 
Scores on one or more of the tests have been established as acceptance 
requirements for 46 types of enlisted men's training programs. 

A second use of the Basic Test Battery has been to provide a 
measure of the quality of the enlisted men and women who enter 
the Navy. The test scores of all recruits in each naval training center 
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have been forwarded bi-weekly to the Test and Research ern 
Bureau of Naval Personnel. Statistical summarics have е 
pared each month showing the mean, standard deviation, P ra ве 
of scores оп each test іп each center and in the total E E 
tion. These data have been used mainly for two purposes: 4 ) 2 
compare the recruits at different centers over the same perioc 


onl cado у sf 
time, and (2) to study the variation in test scores at all centers ove 
the course of time. 


DxsciirrioN or Basic 'ГЕУГ DATIERY 


‘Time Limit in 


Number of Items Minutes 
Name of Test Total Part Total Part 
GENERAL CLASSIFICATION TEST 100 $3 
Partl Sentence Completion 30 10 
Part2 Opposites 30 : 
Part 3 Analogies 40 15 
READING TEST 30 25 
ARITHMETICAL REASONING TEST 30 30 
MECHANICAL APTITUDE TEST 129 34 
Part 1 Block Counting 45 6 
Part 2 Mechanical Comprehension 44 20 
Part 3 Surface Development 40 8 
MECHANICAL KNOWLEDGE TEST 135 37 
Part 1 Tool Relationships 
Electrical 25 6 
Mechanical 30 6 
Part 2 Information 
Electrical 85 12 
Mechanical 45 18 


The following raw scores are commonly 
derived from the test: 


a. Electrical Score (60 items), Tool 
Relationships plus Information. 
b. Mechanical Score (75 items), Tool 
Relationships plus Information. 
CLERICAL APTITUDE TEST 


1 13 
Part 1 Alphabetizing = 55 : 
Part2 Name Checking 83 " 
Part3 Number Checking 75 s: 
SPELLING TEST 50 12 
RADIO CODE TEST 


150 30 
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Basic Теѕт BATTERY (FLEET EpItIon) 


Suggested Time 
Limit in Minutes 4 


Number of Items Еог Еасћ For Each 


Name and Description of Test in Each Test3 Book Test 
BOOK ONE 55 
Directions 5 
Electrical Knowledge Vest 45 10 
Mechanical Knowledge Test 
(minus verbal items) 45 10 
General Classification Test 
(minus the opposites items) 70 30 
BOOK TWO 60 
Directions 5 
Mechanical Aptitude Test 50 20 
Arithmetical Reasoning Test 30 35 
BOOK THREE 10 
Clerical Aptitude Test 250 10 


? The items of each test are of the same type as in the corresponding test of the Basic 
Test Battery, 


li ‘The time limits for the separate tests of Books One and Two are suggested time 
imits only, The subjects are timed on cach Book as a whole. 


A third use of the Basic Test Battery has been at advanced classi- 
fication centers and aboard ship, where scores on one or more of the 
tests have been taken into consideration in the assignment of men 
to stations or billets. For example, all candidates for the submarine 
Service are required to have a score of 50 or higher on the General 
Classification Test. Requirements in terms of scores on the tests of 
the basic battery have similarly been set up for other jobs." 


Analyses of the Basic Test Battery 


The Basic Test Battery has been the subject of a number of 
Studies, some of which were conducted during the development of 
the tests in the interest of perfecting them as instruments of measure- 
ment. Other studies were conducted later in order to determine the 
internal characteristics of the tests, such as reliability, and their 
relationships with external factors, e.g., their validity. In the first 
category of studies, conducted during the process of developing the 
tests, were item analyses and time-limit studies. 


* The Program of selection and classification for which the Basic Test Battery was 
used is discussed more completely in Chapter III. 
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Developmental Studies 


Irem ANALYsErs. With the exception of Form 1, which р 
put into general use without preliminary experimental и 
procedure employed in developing the tests was to T sd 
liminary forms which contained an excess of items and to a mi " ot 
these to sample groups which were chosen to be еи sad 
the total recruit population. Analyses were then made of all е um 
items in the preliminary tests, and on the basis of the results o om 
analyses the best items were retained for the final forms of each test, 
which were used nationally. " 

In the item analyses of the Form 1 tests, the primary empia 
was placed on the correlation of each item with the subtest of == 
it was а part. For each item, the mean total score on the subtest iem 
computed for those persons who selected each alternative pii 
and for those who omitted the item. The value of each item wa 
determined by comparing the mean total score made by pene 
who answered the item correctly with the mean total score made ay 
those who did not. The efficiency of the alternative (wrong) answers 
as "distractors" was also assessed from these data. : f 

A secondary criterion of a satisfactory item was the proportion 0 
those attempting it who answered correctly. For each subtest, a dis- 
tribution of item-difficulty was sought in which there would be a S 
easy and a few difficult items and a concentration around the mid- 
point between chance and perfect proportions. 


5 : = ich 
In general, a Satisfactory item was considered to be one whic 
showed: 


à. a reasonable number of omissions; 
b. a mean subtest score for those 

which was higher than the gen 
C. a set of efficient distracting alt 


М se 
persons selecting the correct respon 
eral mean for the subtest; 

ernative answers, 


Form 1 was Intensively studied after being put into general us 


. 3 H ras 
edge gained in these studies W 
helpful in th 


asic Test Battery (with the excep 
» item analyses were made 


E n 
comparing t 27 per cent of the distribution 9 


each test.9 


8 See Flanagan, J- C. “Gener, 1 Consi i А i » Jour: 
Educ. Psychol., 1939, 30, pp. 674.580 orations in the Selection of Test Items, 
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forms. Each of these forms was given to a carefully selected sample 
of recruits at a naval training station. During the administration of 
cach test the recruits were required to indicate on each test or sub- 
test the progress made at the end of a chosen period of time. Three 
time limits were chosen: a long time period which should allow 
nearly all the recruits to finish, and two shorter periods. The proce- 
dure was for the experimenter to call "Mark" at the end of the short 
period, and have the recruits mark their papers at the item on which 
they were then working. After an extension of time the experimenter 
called *Mark" again and the recruits again indicated their progress. 
The third limit was arrived at by another extension of time. 

Scores on the first and second time limits were correlated with 
the maximal score obtained by the greatest time allowance. The 
Proportion of recruits completing each test or subtest within each 
tme limit was also determined. The time limits to be allowed for 
cach test in final form were determined on the basis of the following 
Criteria: 

a. Ше time limit for which scores correlated highly with those ob- 

tained under the maximal time allowance; 
b. a time limit tinder which approximately 50 per cent of the subjects 


finished the test; 
€ а time limit for which there was a well-balanced distribution of 


Scores. 


Normative Studies 


Norms. In the establishment of norms for the Basic Test Battery, 
а standard scale was devised on which the mean score for each test 
Was assigned a value of 50 and the standard deviation a value of 
N Scores from all training centers were reported in terms of this 
‘Navy Standard Score (NSS). The groups from whose data the norms 
Were established were chosen to be representative of the „entire 
recruit population. All training centers were included, each in pro- 
Portion to its contribution to the national intake of recruits. Norms 
for all forms of each of the tests have been established in a similar 
manner, ‘ 

Norms for the Fleet Edition of the tests were derived in a similar 
manner by administering the tests of this edition at a naval training 
Station together with Forms 1 and 2 of the Basic Test Battery. The 
technique employed with the General Classification "Test was as 
follows: 

Two groups of recruits were chosen. One group took the experi- 
Mental test of the Fleet Edition and Form 2 of the Basic Test Battery. 

€ other group took Forms 1 and 2 of the Basic Test Battery. From 
the results of these administrations it was possible to compare Form 
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1 with the Fleet Edition test which was intended to be parallel to it. 
These two forms could not be given to a single group, inasmuch as 
the contents of the two tests were in large part identical. Statistical 
procedures were then used to equate the scores of Form 1, Basic 
Test Battery with the scores of the Fleet Edition test. 

Comparison ОБ Stations. It had been noticed that differences 
existed in scores made by recruits at different naval training stations 
on the tests which were in use prior to the introduction of the Basic 
Test Battery. A study of these tests, made in early 1943, had shown 
that some of the stations regularly received recruits of apparently 
higher caliber than those in other stations. Since each station regu- 
larly reported the mean, range, and standard deviation for its те- 
cruits on all tests of the Basic Test Battery, it was possible to compare 
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Month and Year 


Figure 5-v1. Monthly trends in scores in verbal 
and mathematical tests of the Basic Test Battery. 


the recruits in different stations, and therefore, in different parts о! 
the country over a long period of time. The results of the compar 
son of five stations are shown in Table 1-v1. А 
Time Ткекр5. Since each station reported its scores bi-weekly, 1 
was possible to observe the trends in mean scores over a long perio 
of time. The results of the study of these trends are shown in Figure? 
5-v1 and б-ут. It can be seen in these figures that, although there are 
some differences among the tests, and there is a difference betwee? 
the two years shown in the figures, the general trend is for high mean 
scores in June and July and low scores toward the end of the yea: 
Several factors undoubtedly contribute to this trend, but prom” 
nent among them are probably the following: June and July are 
the months in which high school graduates entered the service? 


TasLe l-vI. Mean scores on Forms 2 and 3 of the Basic Test Battery for five Naval Training Centers 


Station 
Al Be сз D4 E5 All Stations 6 

‘Test Form2 Еогт 3 Form 2 Form2 Form3 Form2  Form3 Form2 Form3  Form2 Form3 

‘General Classification Test 49.1 48.4 51.5 51.2 53.5 50.6 51.2 48.7 51.3 50.5 51.8 

Reading Test 50.4 50.1 53.2 52.7 55.6 517 51.9 49.1 58.1 51.8 53.4 

Arithmetical Reasoning Test 49.2 48.6 51.5 51.7 54.2 49.6 49.8 48.4 49.8 50.4 51.4 

Mechanical Aptitude Test 50.4 50.9 52.7 52.0 54.0 49.5 50.9 49.5 53.2 51.0 52.7 
Mechanical Knowledge Test 

(Mechanical Score) 49.6 47.1 53.5 51.6 50.8 48.3 47.6 49.7 50.6 50.6 49.5 
Mechanical Knowledge Test 

(Electrical Score) 49.7 48.4 52.0 51.8 54.1 48.4 49.7 48.8 51.2 50.4 51.6 


1 For Form 2, N = 84,107; for Form 3, N = 37,576. 

? For Form 2, N — 108,701 to 108,875. 

3 For Form 2, N — 286,860 to 288,034; for Form 3, N — 120,005 to 120,865. 
5 For Form 2, N — 178,327 to 178,328; for Form 3, N — 72,835. 

5 For Form 2, N — 116,035 to 117,730; for Form 3, N — 70,956 to 71,333. 

9? For Form 2, N = 776,884 to 774,705; for Form 3, N = 302,526 to 301,372. 


[ouuosioq porstpuy 


19 


68 Basic Tests 


During these months, also, the men who failed as pg и SS 
the V-5 program, but who were above the average ka vue си 
tests, reported at the naval training centers and took the Вг 
n evident from Figure 5-уг that the scores for 1945 on am 
of the tests, notably the Mechanical Knowledge Test cen 
Score) were lower than in the preceding year. This was р! one 
due to the fact that recruits in the latter year were in ге 
younger than in 1944. It has repeatedly been found that age is i 
tively correlated with scores on mechanical information tests. 8 
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Figure 6-vr. Monthly trends in scores on me- 
chanical tests of the Basic Test Battery. 


correlation probably accounts for the trend of this mechanical score 
over the two years. 


Test Reliabilities 


numbered items were compute 
rrelated. The resulting coefficients of correlatio” 
п Prophecy Formula to obtai? 
full-length tests. The Kude™ 
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Richardson Formula No. 21 has also been used in calculating re- 
liability coefficients for these tests and for the Clerical Aptitude and 
Spelling tests. The estimated coefficients of reliability are shown in 
Table 2-vr. 

Inspection of Table 2-v1 reveals that three of the tests, the General 
Classification Test, the Mechanical Aptitude Test, and the Mechani- 
cal Score of the Mechanical Knowledge Test are highly reliable, with 
odd-even coefficients of .90 or more on all forms. 

The Arithmetical Reasoning Test has a satisfactory reliability on 
all forms, especially in view of the small number of items (30) in the 


TABLE 2-vi.. Estimated reliability coefficients of Basic Test Battery based 
upon data obtained from routine administration to recruits! 


Alternate-form 
Reliability of Each Form = Reliabilities 3 


Test Form 1 Form 2 Form3 Forms1&2 Forms2&3 


General Classification Test — .91(200)  .95(200)  .96(250)  .90(450) .93(500) 
Reading Test .82(200)  .89(200)  .87(950) .72(450) .81(500) 
Arithmetical Reasoning Test .86(200) .88(200) _ .90(250) .82(450) .86(500) 
Mechanical Aptitude Test 95(200)  .95(200) .95(200)  .88(250) .87(500) 
Mechanical Knowledge Test 


i (Mechanical Score) -90(200) .92(200) -91(200) .87(250) :86(500) 
Mechanical Knowledge Test 
а 1еештса] Score) 84(200)  .89(200)  .82(200)  .78(250) .83(500) 
S lerical Aptitude Test 91(780)* — 95100 зоо 
Spel ing Test .85(780) 4 .91(400) * -73(400) 

adio Code Test :88(470) 5 


E Figures in parentheses represent the number of cases in the samples used for com- 
Puting reliabilities, | 
ang Déarman-Brown Formula used to estimate reliability from correlation between odd 
even-numbered items except where indicated by footnotes 4 and 5. 
4 SEE 9n the correlations between alternate forms of the same tests. 
55 Cliability coefficients computed by Kuder-Richardson Formula No. 21. 
I and p an: Brown Formula used to estimate reliability from corrclation between Part 
art II, 


test. A relatively small increase in the length of this test would suffice 
to raise its reliability above .90. Such a change was introduced in the 
new experimental form, X-4, by the addition of a test of arithmetical 
Computation to the arithmetical reasoning items. Data regarding 
this new Arithmetic Test are not yet available, but it is confidently 
ed that the reliability will be higher than on the first three 
orms. 

The reliability coefficients of the Reading Test and the Electrical 
Score of the Mechanical Knowledge Test are satisfactory for screen- 
INg purposes, but should be higher if the tests are to be used for 
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assigning personnel to one school rather than см вери |" criticism 
applies particularly to the Mechanical Knowledge es 4 За 
The alternate-form reliabilities of all tests are lower t oa 
odd-even estimates. This result is to be expected in view of idea 
that a test typically correlates with itself higher than with ges E 
test. In the case of the correlation between Forms l and 2 0 dus 
Reading Test, Spelling Test, and Mechanical Knowledge на 
(Electrical Score) the correlations, all below .80, indicate that t 
two forms were not very exactly matched. | 6 - 
Basic Test BAtrery (FLEET Eprriox). The tests of the Fleet Ес E 
tion of the Basic Test Battery were intended to parallel the forms 
used in training centers. Estimates of the reliabilities of the tests 
the Fleet Edition were computed by the Kuder-Richardson Formula 


Taste 3-vi. Reliability coefficients of Basic Test Battery (Fleet Edition) 
based on data from recruit performance 


Correlations of Tests at 
Estimated Reliability Basic Test Battery (Flee 


Coefficients; Basic Edition) with Comparable 
Test Battery (Fleet ‘Tests of Basic Test 
Test Edition) Form 11 Battery, Form 1 att: 
General Classification Test -90(500) 2 -81(500) 
Arithmetical Reasoning ‘Test -77(500) -86(500) 
Mechanical Aptitude Test -88(500) -74(500) 
Mechanical Knowledge Test 
(Mechanical Score) :87(500) -64(500) 
Mechanical Knowledge Test 
(Electrical Score) -79(500) :66(500) 
Clerical Aptitude Test -96(400) -78(400) 


! Reliability coefficients computed by Kuder-Richardson Formula No. 21. 
? Figures in parentheses represent number of cases in sample used. 


^ А 5 one 
ауу 5 aptitude testing program to C " 
the type here descril iabili i are по 
acceptable, those from 80 ee scribed, reliability coefficients below .80 а 


sch. 
and those of .90 or above are very hig? 
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ber of items (30). It is therefore likely that the fleet form of the 
Arithmetic Test contained a number of items that are intrinsically 
unreliable. 

_ The extent to which the tests of the Fleet Edition match those of 
Form 1 is also shown in Table 3-vi. Due again to the disparity in the 
number of items, and to the differences in time limits, the correla- 
Hon coefficients are not as high as should be expected of two tests on 
which a large number of items are identical. 


Relation of Test Scores to Age and Educational Level 


Coefficients of correlation between test scores and age and between 
test scores and highest school grade completed were computed for 


Taste d-vi. Correlation coefficients of scores on Basic Test Battery 
with age and with highest school grade completed 


Correlation Coefficients 


Test Score with Navy Standard 
Test Score Highest School Score 
with Age Grade Completed — 
Test (N —906) (№ = 908) M c 
General Classification ‘Test 0 65 50.1 10.6 
Reading Test 02 58 51.0 17 
Arithmetical Reasoning Test 12 57 50.0 11.6 
Mechanical Aptitude Test —.02 52 504 10.3 
Mechanical Knowledge Test 
(Mechanical Score) 30 39 52.1 11.2 
Mechanical Knowledge Test 
Electrical Score) 19 56 50.8 104 
Clerical Aptitude Test —.09 65 50.3 9.2 
Spelling Test 06 58 50.1 9.9 
Radio Code Test—Speed of 
sponse 05 Al 52.3 10.9 
Age — 02 26.1 67 
10.2 2.3 


Highest School Grade Completed —.02 


а National sample of recruits in April 1944. The correlations are 
shown in Table 4-vi. It is clear from this table that the correlation 
Coefficients between test scores and educational level are moderately 
high, as is to be expected. The correlation coefficients between test 
Scores and age are, with two exceptions, close to zero. The exceptions 
are the two scores on the Mechanical Knowledge Test, which, as 
Previously stated, has been found repeatedly to be correlated posi- 
"vely with age. It is noteworthy that of all test scores of the Basic 

est Battery, only these two, from an information rather than an 
‘ptitude test, are correlated with age. The inference is that as опе 


79 | Basic Tests 


i informati relevant 
grows older he may acquire a background of infor rarum an 
i t does no F 
i ectrical tools and processes, bu 
to mechanical and elec too cesses | Mu 
rove in any of the verbal abilities tested, in arithmetical proces: 
bs in the special aptitudes which are included in the battery. 


Intercorrelation Studies 


Two kinds of study are presented as the result of pe rege. 
the tests of the Basic Test Battery in Forms 1, 2, and 3. ‘Tables о 
intercorrelations were prepared in which the relationships of the 
tests could be observed, and some of these tables were subjected to 

| factor analyses in order to disclose the relationships among the tests, 
and what factors were represented by the tests. 

INTERCORRELATIONS. The intercorrelations among the tests of the 
Basic Test Battery, Forms 1, 2, and 3, are shown in Table 5-v1. The 
data for Form 1 of the tests were obtained from a representative 
sample of 500 recruits from all naval training stations from July 
to October 1943. Data for Form 2 were collected from a sample 95 
recruits in all naval training stations in April 1944. The data for 
Form 3 were obtained from a similar sample in January 1945. On 
all three samples the means and standard deviations were very close 
to those of the national recruit population at the time. а 

It can ђе seen from Table 5-уг that all of the tests are positively 
related. The highest correlation coefficients were between the Gen- 
eral Classification and Reading Tests (.80 to .85), which were ex- 
pected in view of the fact that both are tests of verbal ability. The 
lowest correlation coefficients were found between the Mechanical 


Score of the Mechanical Knowledge Test, Form 2, and the scores 
on Form 1 of the С] 


erical Aptitude, Spelling and Radio Code Tests 
(36, .33, .34). 
The Arithmetical 
mechanical tests corr 
sirable. The Mechan 


Reasoning Test and the three scores on the 
elate higher with the verbal tests than is de 
ical Score of the Mechanical Knowledge Test 


€ mechanical test score which is most indepen 
Y. The correlation coefficie 


t was an important pert 
h parts of this composite tes 
rent in content, correlate 
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pictorial items with electrical-pictorial, and of mechanical-verbal 
with electrical-verbal, were as high as, or higher than those of 
mechanical-pictorial with mechanical-verbal items or of electrical- 
Pictorial with electrical-verbal items. It was partly because of the 
intercorrelation between the two scores of the Mechanical Knowledge 


Taske 5-vi,. Intercorrelations among tests of the Basic Test Battery based 
on data from routine administration to recruits і 


Navy Standard 


Variable Score 
Test n o D E F @ H it M c 

^ General Classification 

Form 1 81 69 .60 49 .53 47.50 10.21 

Form 2 85 79 .69 .57 78 68 68 .61 50.13 10.53 

Form 3 S81 72 .60 48255 52.90 1041 
n Reading 

Form | 69 56 46 .51 45.00 10.00 

Form 2 47 67 58 G8 64 .63 .51 51.15 11.61 

Form 3 68 61 50 .60 54.09 10.85 
С Arithmetical Reasoning 

Form 1 61 41 47 45.00 9.95 

Form 2 69 53 68 .64 .58 .51 49.99 11.62 

Form 3 59 41 .50 51.04 11.16 
D Mechanical Aptitude 

Form 1 55 58 48.00 10.31 

Form 9 61 69 65 48 AD 50.5] 10.28 

Form 3 59 .60 52.95 9.82 
E Mechanical Knowledge 

(Mechanical Score) 

Form 1 78 48.00 10.55 

Form 2 75 36 .33 .31 52.32 11.19 

Form 3 68 49.67 9.77 
Е Mechanical Knowledge . . 

(Electrical Score) 

Form 1 48.00 947 

Form 2 55 51 45 50.89 10.43 

Form 3 51.56 9.62 
G Clerical Aptitude 

Form 1 66 .53 50.24 09.08 
Н Spelling 

Form 1 39 5012 9,89 
I Radio Code 

Form 1 52.38 10.95 


l'The data for Form 1 are based on a sample of 500 persons for whom scores were 
obtained on Form 1 of the General Classification Test, Reading Test, Arithmetical 
Reasoning Test, Mechanical Aptitude Test, Mechanical Knowledge Test (Mechanical 
Score), and Mechanical Knowledge Test (Electrical Score). The data for Form 2 were 
Obtained from a sample of 933 persons for whom scores were obtained on Form 2 of 
the tests listed above plus Form 1 of the Clerical Aptitude Test, Spelling Test, and 
Radio Code Test. The data for Form 3 are based on a sample of 803 persons for whom 
Scores were obtained on Form 3 of the general tests of the battery. 
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Test that an extensive revision of the format of this test ane seria 
taken for Forms 4 and 5. Since the Electrical Score was quite ug 
correlated with the Mechanical Score, the advantage of using vm 
scores was questionable. Since the reliabilities of one of a “rir 
(Electrical) was not particularly high (.82 to .89), and the tekabul } 
of the difference between the two scores was low, the classification 
of individual men based on this difference was subject to rather 
large errors. Therefore, in the new experimental forms of the 
Mechanical Test an effort was made to increase the reliability of the 
test, and the verbal items were deleted. In their place, the Mechani- 
cal Comprehension items from the Mechanical Aptitude Test were 
substituted. Data are not available at present on the reliability of 
the new forms. 

Factor ANALYsEs. Two factor analyses have been performed on 
the tests of the Basic Test Battery, the first on Form 1 of the general 
tests, and the second on Form 2 of the general tests plus Form 1 о! 
the Clerical Aptitude, Spelling, and Radio Code Tests, The first 
analysis revealed three factors, one clearly verbal and best repre- 


sented by the General Classification, 
Reasoning Tests, 


the Mechanical К. 
well defined in th 
cal Aptitude Tes 


verbal and mechanical factors) being .19. It is 
i d to disclose any independent 
: ing factor represented by the Arithmetical Rea- 
soning Test. 

The second analysis, including all of the special tests of the bat- 
tery, revealed four factors. The first was again a general (verbal) 
intelligence factor, the second a mechanical information factor, and 
the third and fourth were not well defined. 

The loadings of all tests on the first factor (A) are .57 or higher, 
and the verbal tests and Arithmetical Reasoning Test have high 
loadings (.86 or higher) on this factor and very low loadings (11 
or less) on the other three. From this it appears that Factor A is 2 
ete of verbal intelligence, which is correlated with all 
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Factor C was represented, as in the first analysis, primarily on the 
Mechanical Aptitude Test, and in this analysis on the Radio Code 
Test. Since the Block Counting and Surface Development parts of 
the Mechanical Aptitude Test involve the ability to perceive visual 
relationships, and the Radio Code Test involves the ability to per- 
ceive auditory relationships, Factor C has been called tentatively 
“Speed in perception of visual and auditory relationships.” 

Factor D is also not well defined in the analysis. The Spelling Test 
is the only one which has moderate loadings on it and zero loadings 
on Factors B and C. The Clerical Aptitude Test has loadings of .30 
on both Factors C and D. 


Validity of the Basic Test Battery? 


. Since Form 1 of the Basic Test Battery was put into national use 
in June 1948, a continuing program of studies of the validity of the 
tests has been carried on to insure that the tests are used as effectively 
as possible. In these studies the validating criterion has been success 
1n service schools. 

The usual procedure employed in the study of the validity of the 
Basic Test Battery in predicting success in service schools has been 
to compute correlation coefficients between the trainees’ service 
school grades and the scores on one, and on combinations of two 
ог more tests of the Basic Test Battery. In the latter case multiple 
Correlation coefficients and correlation coefficients based on the 
summed scores of the two (or more) tests have been used. 

It has been found in these studies that every one of the six scores 
obtained from administration of the general tests of the Basic Test 
Battery has been useful in classifying men to some school. The best 
Single test, and the best combination of two tests, for predicting 
success in different schools, has, of course, varied from school to 
School. The degree of relationship has also varied, but in general 
the most valid single test score has correlated approximately from 
‘40 to .65 with school grades, and the best combination of two tests 
approximately from .45 to .70 in terms of multiple correlation.? The 
xu a more detailed discussion of the validity of the Basic Test Battery, see Chapter 

9 á ma Р > te: ions wi ade for 
the certe дв е vll cacti e med, he соса one base 06 
the dispersion of ране in the total recruit population for which the standard deviation 
Was known to be 10. The formula for this correction for curtailment has been given by 
Kelley, Truman L., Statistical Method, Macmillan, New York, 1923. The second statis- 


tical Procedure consisted of averaging the various coefficients obtained at a sample of 


schools by mea i f Fisher. The procedure followed in trans- 
ns of tl transformation of Fishe P 
formin; San e х to т has been described by Peters, C. C., and 


B to z and converting the averag E Д 
Уап Voorhis, W. R. ти Procedures and Their Mathematical Bases, McGraw- 


Hill, New York, 1940. 
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i es 
correlation coefficient between school grades and the summed scor 


on two tests were generally .01 to .03 lower than the multiple corre- 
lation coefficients. 


Extensions of the Basic Test Battery 


Aside from the Fleet Edition of the Basic Test Battery, which has 
already been described, two additional tests were developed for use 
with enlisted personnel, one to be used in addition to the basic bat- 
tery, and the other as a substitute for one of the tests in the battery. 
These extensions of the Basic Test Battery were the Applicant Quali- 
fication Test and the Arithmetical Computation Test. | 

APPLICANT QUALIFICATION Test. The Applicant Qualification 
Test was developed for use in the intellectual screening of 17-year 
old applicants for naval service. The test was designed (1) to require 
less than one hour of testing time, (2) to be suitable for hand-scoring, 
(3) to be printed in expendable booklets, (4) to yield a single score 
which would be convertible to Navy Standard Scores for purposes 
of comparison, (5) to be capable of administration, scoring, and inter- 
pretation by relatively untrained personnel, and (6) to be available 
in several forms. 
der to meet the needs of the Navy for 
ant Qualification Test should be a com- 
metical and mechanical abilities as well 
s to be used for screening, and would be 
Ose at the bottom of the distribution of 
зе а preponderance of easy items in order 
poer ved distribution of scores, "Thus the finest 
discrimination would be obtained where it was most needed, at the 
lower end of the scale. 


Description. The Basic Test Batt 
Source of Supply of items for the Ap 


Administrati i pee 
Mee on. An experimental form containing 100 items “2$ 
nistered to 412 recruits at à Naval training center. On the basis 
of an item analysis, the 80 best i i 


items were retained for Form 1. THS 
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Test Number of Items 


Applicant Qualification Test, Form 1 


Analogies 16 
Sentence Completion 16 
Arithmetical Reasoning 20 
Mechanical Information 16 
Electrical Information 12 

Total 80 


test was then given to a sample of 500 recruits, with whom it was 
found that the 45-minute time limit permitted the majority to com- 
plete the test. 

Form 1 of the Applicant Qualification Test was then administered 
to 509 recruits who comprised the standardization group., One-half 
took the test shortly before the Basic Test Battery, and the other 
half shortly after taking the Basic Test Battery. 

The mean raw score in the test was 49.13 and the standard devia- 
tion was 16.28. The distribution of scores showed a slight negative 
skewness, which indicates good discrimination on the test in the 
region where it is desired. 

Reliability. The reliability of the test, calculated by the Kuder- 
Richardson Formula No. 21, was found to be .90, which is a slight 
underestimation owing to the assumptions of complete homogeneity 
and equal difficulty of items which underlie the Kuder-Richardson 
Formula. An odd-even reliability coefficient would probably be some- 
what higher than .90. у 

Validity. Estimates of the probable validity of the Applicant Quali- 
fication Test for screening the 17-year old applicants for naval serv- 
ice were made by noting the correlation coefficients between it and 
the Basic Test Battery. It was found that the highest correlation 
Coefficient was between the Applicant Qualification Test and the 
General Classification Test (.85), while the others ranged from .57 
to .80. It is felt that insofar as the Basic Test Battery scores are valid 
Predictors of performance in naval training schools, the Applicant 
Qualification Test shows promise of effectiveness, owing to its corre- 
lations with the Basic Test Battery. 

ARITHMETICAL COMPUTATION ТЕТ. As a result of finding that the 
Arithmetical Reasoning Test correlated quite highly with the verbal 
tests in the basic battery, an attempt was made to devise an arithmetic 
test relatively free of the verbal factor. To this end the Arithmetical 
Computation Test was constructed. In this test the attempt was 
made to have the scores reflect more the recruits’ ability to manipu- 
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late numbers and less the ability to read directions and AT 
words. Accordingly, the directions were made as simple as possi к 
the testees being instructed merely to add, subtract, multiply о 
divide the numbers given them. M 

Construction and Analysis. An experimental form of the test Was 
constructed of sixty items of free-answer form. In the test the iur 
fundamental operations of arithmetic were about equally ерте 
sented. The test called for the ability to manipulate whole numbers, 
decimals, and fractions. This test was administered to 1,430 recruits 
at a naval training center, and an item analysis was performed on 
a random sample of the answer sheets. The wrong answers most 
commonly given to the items selected for retention provided the 
distractors for the multiple-choice form of the test which was issued 
later. This edition of the test was given to another 
recruits and was item-analyzed. 

Statistical Characteristics. A study of the statistic 
of the first multiple-choice form of the test, Form 
it had a satisfactory difficult 
a mean of 24.2, a standar 
cient of .95. The items x 
the median biserial coe 

Correlational an 


sample of 1,000 


al characteristics 
X-2, revealed that 
y and reliability. The fifty-item test had 
d deviation of 11.9, and a reliability coeffi- 
vere uniformly of high discriminative value. 
ficient of correlation being .70. 

alysis showed, however, that the scores on the 
Arithmetical Computation Test correlated as highly with General 


Classification Test scores (76) as did the scores on the earlier test 
of arithmetical reasoning (.69 


cluded that the Arithmetical 


Selection Tests Developed for the Literacy Training Program 


у established a training Program for non-readers 
» It became necessa 
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reading comprehension items of the type illustrated in Figure 7-v1. 
It will be noted that the items are constructed from materials drawn 
from the experience of naval personnel. The items are arranged 
roughly in order of difficulty, and no time limit is used. The exam- 


Sample А. A word-recognition item. 


Sample В. 


A sentence-reading item. 


Sample С. Paragraph rcading. 
Each recru 


d it is given a complete outfit of 


SPINE when he enters the Navy. He is 
ene a stencil for marking his clothes. 
last f makes proper care of his outfit, it will 
“St lor a long time; and if he marks every- 


thing with his name, he won't lose any- 
thing. 


Figure 7-v1. Literacy 


The test contains 20 of these items. 


light 
window 
hinge 
blind 
windy 


The test contains 16 of these items. 


There is a ship in sight. 

The sailor is looking upwards at something. 
‘The glasses are very powerful. 

\ battle is about to begin. 


The test contains 8 of these items. 

A recruit 
should buy his clothes before he enters 
the Navy. 
should make the clothes given to him 
last until the end of the war. 
will lose а month’s pay if he doesn’t 
mark his clothes. 
should take proper care of the clothes 
that are given to him. 


test sample items. 
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inee records responses by encircling the word, phrase, or statement 
i ieves to be correct. и 

Phe Litem Test was standardized by àdministering sippar 
Gates Reading Survey Test to two companies of taci ey a Бн 
training center and to two companies in the special ано тн 
program. On the basis of data thus obtained, a coos E oes 
was constructed for converting raw scores in the Literis : - fone! 
reading grade levels. Recruits scoring below fifth-grade reac ing 

and possessing sufficient mental abil 


tion were to be transferred 
reading. 


ity to profit from special Pupi 
: "i x 3 
to the special training program 1 


At the time of the termination of hostilities, Form X-2 had been 
developed and was in the process of standardization, This form aia 
tains 60 items distributed as follows: word recognition, 20; sentences, 
15; paragraph reading, 25. The directions for Form X-2 are given 
orally instead of printing them in the test booklets. The respons 


` А : 4 drive xes 
technique was changed from encircling responses to checking bo 
placed opposite the choices. 


Now-VznnAL CLASSIFICATION 
measure the learning ability of r 
ing or General Classification Te 
determine whether they роѕѕеѕѕе 
from instruction in re 
facts were kept in min 
(2) it would have to b 


Test. This test was developed to 
€cruits who scored low in the Read- 
sts of the Basic Test Battery, and to 
d sufficient mental capacity to profit 
ading. In building the test, two a мар 
d: (1) the test would be used with adults, an 
е given to large 8roups of men. Furthermore, 
а пап 5 score in the test should serve in the place 
of the General Classification Test Score as the index of his general 
mental ability, 


Three types of items were chosen for 


use in the test: analogies: 
identification of the “ 


figures in a series, and com- 


group consisted of 1,071 illiterates, 
deviations in the t 


€st (100 it f 
literate 56.8 and 16. a ~ Items) for the 


Sample A. Analogies type item. 


Fd 


Sample C. Completion type item. 


The test contains 30 of these items. 


Eras 


The test contains 20 of these items. 


‘The test contains 25 of these items. 


G Gf > g 


Figure 8-v1. Non-verbal classification test sample items. 


[9uuosroq poasr[ug 
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Revisions and Future Developments 


In the course of the studies of Forms 1, 2, and 3 of the Basic li 
Battery, several instances of failure of the tests to perform ората. У 
became evident. For example, from the intercorrelation — € 
cluding the factor analyses, it was evident that the Arithmetica 
Reasoning Test was highly related to the verbal tests and. that no 
independent quantitative or numerical reasoning factor was керге" 
sented by any of the tests. The Arithmetical Computation Test А 
resented ап attempt to reduce to a minimum the required verbal 
intelligence, but it correlated as highly with the verbal measures as 
did the Arithmetical Reasoning Test. The Arithmetic Test in Forms 
4 and 5 consists of both computational and arithmetical reason- 
ing items. 

Intercorrelation studies also showed ah 
between the General Classification Test 
the General Classification Test had 
somewhat superior to the Reading Test in the prediction of success 
in service schools, it was decided to retain the General Classification 
Test as the measure of verbal ability in Forms 4 an 5 and to omit 
the Reading Test. 


In the measures of mechanical abilities in Forms 1, 2, and 3, two 


scores were derived from the Mechanical Knowledge Test (Mechani- 
cal Score and Electrical Sc 


ore) in order to make differential classifi- 
cations to electrical or mechanical schools, F 
ferential classification both tests w 


that the differences between score 
electrical score was not high enot 


tion to be based on the difference 
cal knowledge. 


In the ex 


igh degree of relationship 
and the Reading Test. one 
a higher reliability and seemed 


or the purpose of dil- 
ould nced high reliability in orde! 
5 be reliable. The reliability of the 
igh to permit dependable classifica- 
between the two scores of mechani- 


tests in Forms 1, 2, and 3, the three which аге 


General Classification Test’ 
- Of the three special Lc 
retained. The Spelling Tes 
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is being deleted entirely and the Radio Code Test will be admin- 
istered as a special aptitude test. 

In the interest of processing enlisted men at the highest possible 
speed during the war, all men were given the entire battery of basic 
tests. At that time it was felt, however, that other procedures, more 
economical of testing time, might be preferable for long-term pur- 
poses. Among such possible programs, consideration should be given 
to the possibility of a multiple-stage testing program which would 
utilize a short primary battery, given to all men for screening pur- 
poses, and additional secondary batteries to be given to smaller 
numbers of men for the purpose of classification for specific schools. 
Related problems concern the smallest number of tests which can 
be used effectively in the primary battery, and what special tests are 
needed in the secondary stage. 

Thought is also being given to the possible use of other types of 
tests in the secondary stage of testing. Among the types being con- 
sidered are proficiency tests, tests of interests and personal adjust- 
ment, and aptitude tests of the performance type. A more extended 


an of these and related problems will be found in Chapter 
XXII. 


CHAPTER VII 
BASIC TESTS FOR OFFICER PERSONNEL 


Owinc to the very rapid expansion of the Navy in 1942, Бен im 
need for a general purpose test which could be used in the selec E 
of officer candidates. At that time large numbers of officers w у 
taken into the Navy directly from civilian life through the offices a 
naval officer procurement. They were then sent to ma Ea 
schools for training. The first test for officer candidates was co 
structed for use at the offices of naval officer procurement for the 
purpose of screening out those persons who probably would е 
succeed іп Navy training programs or billet assignments. Subseque 5 
tests were devised to be administered at primary officer schools от 
classification centers to provide differential information regarding 
more specific aptitudes of officer candidates. This differentiating 10 
formation could be used in classification for further training or for 
specific ship or shore billets. - 
The principal criterion against which the success of any selectio i 
program in the Navy should be measured is, of course, an individua 
officer’s success in the performance of his duties. The final validity 
of the tests developed for selection and classification should, there- 
fore, be estimated only after correlating the test results for a large 


number of individuals with accurate and reliable appraisals of their 
performance on the job. $ 


The lack of time available for 
tion tests for naval officer candi 
dation of the tests by performa 
candidates accepted at offices of 
to some school for training, th 


offices could be validated agai 
be used at once in 
failures. The first ai 


the development of workable selec- 
dates, however, precluded any vali- 
nce criteria. But, since most officer 
naval officer procurement were sent 
e selection tests to be used at these 
nst achievement in school and could 
an effort to reduce the proportion of training 
m of a selection test was, therefore, to screen out 
the candidates who would probably not succeed in Navy training 
programs. For this purpose the Officer Qualification Test (097) 
was developed. Th administration during tbe 
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Since the Officer Qualification Test was the first of the basic tests 
developed for officers and since it served as the model for the devel- 
opment of later tests, it has been more extensively studied than 
any other, and hence is described in greater detail in this report. 


Officer Qualification Test 


Та view of the fact that the Officer Qualification Test was to be 
given at many different places by personnel not uniformly trained 
for the purpose, one of the first specifications set up for the test was 
that it be virtually self-administering. The use of a self-administering 
test would obviate the need for trained testing personnel or for 
rigid standardization of the procedures to be employed in giving 
the test, 

The limited testing time available at the offices of naval officer pro- 
curement imposed the additional requirement that the Officer Qualifi- 
cation Test take not more than one hour. It was specified, however, 
that it bea power test. This meant that even if the time-limit were re- 
moved, the variability of test scores should remain large. Particularly, 
it meant that with the time-limit of one hour the scores should not 
reflect merely speed in making decisions and recording answers. 

Until late in 1942, no single general aptitude test had been uni- 
formly used at the various offices of naval officer procurement in the 
Selection of candidates for commissions. By December of that year, 
ап experimental form of an officer qualification test, called the 

сеге’ Selective Examination (SE O-1) was developed and put into 
use at the New York Office of Naval Officer Procurement. On the 
basis of an analysis of a sample of answer sheets from that office, the 

fficer Qualification Test, Form 1, was prepared and used nationally. 

After Form 1 had been put into use at all offices of naval officer 
Procurement, the preparation of two parallel forms of the Officer 
Qualification Test (Forms 2 and 3) was begun. The first step in 
the Preparation of Forms 2 and 3 was to devise a lengthy experi- 
Mental test (Form О-9) by adding to Form 1 enough items to provide 
Ог two parallel forms, with a number of excess items which could 
be discarded. Form O-2 was administered to a group of male officer 
Candidates at a naval indoctrination school and to a group of women 
at à reserve midshipmen’s school for WAVES officers. From the results 
obtained, the items of the test were analyzed with respect to their 
difficulty and their biserial correlations with the appropriate sub- 
tests. On the basis of this analysis, the items of Forms 2 and 8 of 
the Officer Qualification Test were selected. 

Description. It was decided that the Officer Qualification Test 
Should consist of three parts—vocabulary, mechanical comprehen- 
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sion, and arithmetical reasoning. The choice of these three we 
made on both empirical and rational grounds. In the int p! т 
independent verbal, mechanical, and arithmetical abilities are ive 
cated in factorial analyses of mental ability. Secondly, tests of ES : 
abilities appear to be requisite for valid selection of candidates [01 
naval officer training schools. | И 
The vocabulary part of the Officer Qualification Test was саи 
as а representative measure of verbal abilities, which are pis 
to success at officer candidate school. The ability to comprehend 
quickly and easily the material presented in texts and lectures yar 
considered especially valuable at a time when the training courses 


at these schools were condensed and presented to the students at a 
greatly accelerated rate. 


The mechanical com 


prehension part of the Officer Qualification 
Test was intended to m 


савите some of the mechanical abilities which 


ch involve mechanical equip- 
esult, success in officer training 


ty to those without extensive mathematical 
itative section of the Officer Qualift- 

their solution a knowledge 
athematics. Therefore, items 
Id be solved by simple arith 
f the task, however, was t? 
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The candidate indicates the word selected on his answer sheet. This 
type of item is illustrated in the preceding chapter. 

The Mechanical Comprehension * subtest consists of thirty items. 
Each contains a picture illustrating a mechanical situation and a 
question about the situation. Three answers are given to each item; 
the task is to choose the correct answer and indicate the choice on 
the answer sheet. It was intended that high scores on this test should 
indicate persons who can make reasonable common-sense judgments 
about a variety of mechanical situations. The preceding chapter 
contains an illustrative item of this type. 

The Arithmetical Reasoning subtest contains twenty questions, 
and five alternative answers to each. The task is to decide, by per- 
forming the required arithmetical operations on the data given, 
Which answer is correct. The choice is then to be indicated on the 
answer sheet. An illustration of this variety of item is also given in 
Chapter VI. 

Immediately below is a tabular description of the subtests of the 
Officer Qualification Test. 


Number Time in 

Subtest of Items Minutes 2 
Opposites 50 15 
Mechanical Comprehension 30 15 
Arithmetical Reasoning 20 25 
Checking time 5 
Total 100 60 


? Only the total time limit is strictly observed. The time to be allotted to each of the 
three parts of the test is suggested in the instructions. The total time allowed includes 


five minutes to be used on items originally skipped. 


_ USE or THE OFFICER QUALIFICATION TEST. The Officer Qualifica- 
tion Test has been used in offices of naval officer procurement as an 
Intellectual screening device. In addition to an applicant’s score in 
the test, his educational, vocational and personal qualifications have 
been considered in the processing of his application (see Chapter II). 
Since the Officer Qualification Test has been used as a selection 
device, a critical or “cutting” score of 40 (Navy Standard Score) was 
adopted as the lower limit of eligibility of applicants, except in some 
Cases where a useful experience was extensive enough to compensate 
for a lower score on the test. 


1 Many of the items in the Test of Mechanical Comprehension, Form BB, loaned by 
the Psychological Corporation, were used in the first experimental form, SE O-I. The 


later tests consisted of original items. 
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By the selection of a comparatively low Ls M MN ес: 
possible to eliminate from consideration only those din water 
below the mean, who for intellectual reasons woulc ee! p End 
not have succeeded in primary training. Since the Hed secar 
was great and the majority of applicants were of bci, 8 rs pem 
caliber, it was not deemed necessary to set a high cutting score 
test. 


Statistical Data for the Officer Qualification Test 


The statistical data on the experimental and final forms ol 2: 
Officer Qualification Test will be presented under the weg 
topics: norms, means and standard deviations, reliability anc m: of 
correlations. Except where otherwise indicated, the igi d 
reliability have been computed by the split-half method, и 
by the Spearman-Brown Prophecy Formula. — augue 
parts and validity coefficients have been computed by the proc Ч 2d 
moment method, and correlations between items and parts ar 
biserial coefficients. li- 

Norms. The problem of constructing norms for the Officer Qua г 
fication Test was complicated by the fact that the test was to be hem 
for officer populations from all sections of the country and ther 


s а of 
Was reason to believe that samples drawn from different. offices 


А ; is was 
naval officer procurement might not be equivalent. Added to this wé 
the fact that men and wor 


men officers performed differently, espe 
cially on the Mechanical Comprehension subtest. It was pe 
therefore to prepare separate norms for men and women for Fo! е 
1 оп the basis of the answer sheets of all tests given over selecte 
periods at all offices. 


MEANS AND STANDARD DEVIATION 
EXAMINATION (SE O-1) AND OFFICE 
The first experimental form of an 
put into use in the New York Off 
This test contained 115 items fro 
to be chosen for the Officer 

Table l-vit shows the m 
tests and total tests of th 
Form 1 for both New Yor 

The means of the subte 
size of the Standard devi 
subtests, particularly Arithmeti 


S FOR THE OFFICERS’ SELECTIVE 
R QUALIFICATION TEST, FORM ; 
officer selection test (SE O-1) Wa 
ce of Naval Officer Procurement 
m which, after analysis, 100 wet 

Qualification Test, Form 1. 


а il- 
, Е NTS AND INTERCORRELATIONS, The MR 
ity coefficients of the subtests and of the tota] tests, and the int «4 
€sts of both forms as determined from ВГ 
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TABLE l-vir. Officer Qualification ‘Test, SE O-1 and Form 1. Means and 
standard deviations (raw scores) on the subtests and total test. 
(N = 500 for each of the three samples.) 


SE O-1 Form 1 
3 New York New York National 
Number Sample Number Sample Sample 
of —— of — — —— 
а Items M с Items М с M с 
Subtest Е к ы d 
Opposites 60 3228 1191 50 2777 10.83 25.73 10.46 
A сећати са] Comprehension 30 18.50 4.39 30 15.98 3.73 1643 3.73 
To s ibfmetical Reasoning 25 15.76 4.76 20 10.23 4.19 10.42 4.03 
tal Test 115 66.54 16.84 100 53.99 14.82 5249 13.93 


5 Я А Р 
ги ан are shown in Table 2-уп. In all cases, the Opposites and 
: инана] Reasoning parts and the total test аге satisfactorily 
cable, while the Mechanical Comprehension part is not. The 


Pane evi Officer Qualification Test, SE O-1 and Form 1. Reliability 
coefficients! and intercorrelations of subtests and total test. 
(N = 500 for each of the three samples.) 


Subtest 


Mechanical Arithmetical 
Opposites Comprehension Reasoning Total Test 


T муз 053 N.Y. U.S. N.Y. US. N.Y. US. 
SEO. -— = > 
OPposites 94 
Aschanical Comprehension .28 -73 
T ithmetica] Reasoning AQ 56 .87 
peal Test 90 62 72 93 
FORM | 
Me Posites 93 .92 
Ренна Comprehension .23  .16 64 .62 
Total 1116191 Reasoning 49 36 47 38 .86 .86 
otal Test 91 90 55 50 70 .66 .93 .90 


! Reliabilities were estimated by applying the Spearman-Brown Prophecy Formula to 
“СУСП correlation coefficients. Reliability coefficients are shown in bold face type. 
PN York samples. 
ational sample. 


ielas Й А 
еј low reliability of this section was assumed to be due in 
Tt to its heterogeneous nature. The technique of split-half correla- 


3 лаик " 
80 the research on the Navy's aptitude testing program, reliability coefficients from 
ver © .89 have been considered satisfactory; those of .90 or higher have been considered 
in У Satisfactory; and those below .80 were considered unsatisfactory for tests described 

this chapter, 


90 Basic Tests 


tion, which was used in these computations, gives too low an estimate 
of the reliability of a heterogencous test. niu "Table эхн 
The intercorrelations of the subtests are also shown in Ta sts and 
These intercorrelations and the correlations between et 
total score are somewhat lower for the Officer Qualification | = 
Form 1, than for the Officers’ Selective Examination. Opposites or 
related highest, and Mechanical Comprehension lowest, with x 
score. As a consequence of the high correlation of the Oppo: se 
subtest with total score, this subtest received comparatively hes а: 
weighting in the total test score. The reliability of the total mn 
due largely to this heavy weighting of the most reliable subtes 
the total score. n 
MEANS AND STANDARD DEVIATIONS FOR THE OFFICER QUEE 
TION Test, Forms 2 AND 3. The preparation of Forms 2 and 3 of e 
Officer Qualification Test was based on an item analysis of np e 
perimental form (O-2), which contained 274 items including P а 
in Form 1. Form O-2 was given to about 400 men at a naval indo E 
trination school and to about 400 women at a women’s reserve gom 
shipmen's school. The subtests were printed in separate booka 
and were given separately at both schools (over a three-day en 
at the indoctrination school, and a two-day period at the wen 
reserve midshipmen’s school). About four hours were allowed ae 
all of the tests. This time was considered sufficient to compensi a 
for the large number of items (274) in the tests. On the basis of wa 
analyses of the results of these two administrations of the ST ot 
mental form (O-2), two new forms (Forms 2 and 3), which ње 1 
equivalent in difficulty and item-subtest correlations were pu 
The attempt was made to select pairs of items, one for each eet 
in which the two items were equal in difficulty and item-sub " 


A А ter 
correlation. This procedure matched the two forms item by ! 
rather th 


у А nee was 
an just in mean and standard deviation. No attempt 
made, however, to make Forms 2 and 3 equivalent to Form 1. 


an 
Table 3-уп shows separately for men and women the means ' 
standard deviations of 


iol 

the three forms of the Officer Qualificati? 

Test. It can be seen, first, that the new forms, 2 and 3, were equi it 
lent with respect to their mean scores and standard deviations: | 
Were somewhat easier than Form 1. Second, it is apparent that 
n and women performed differently. The 


т for the women, while the Mechanical 
r for the men. 


t 
ec 
both t ms of the tests had also shown that with те ere 
о item-difficulty and to item-subtest (relation. there 115 
pronounced sex q correlati 
easier for th s o ferences. The Opposites items were g€ 5 
€ women, and the Mechanical Comprehension 
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Pave Зуп. Officer Qualification Test, Forms 1, 2, and 3. Means and 
standard deviations (raw scores) on the subtests and 
total test for men and women 


Subtest 
Mechanical 
Compre- Arithmetical 
OQT Opposites hension Reasoning ‘Total Test 
Form E = 
. Number Population M с м о M o M ec 
Men 1 National Sample 26.0 10.4 16.5 3.6 10.5 40 52.9 14.1 
1 Indoctrination 
School—Class 6 26.7 98 15.3 34 11.0 3.2 53.0 12.5 
2 Indoctrination 
School—Class 7 279 98 163 4.5 124 3.4 56.6 13.5 
3 Indoctrination 
— School—Class 7 982 99 16.2 4.2 124 34 568 135 
Women 1 National Sample — 263 98 194 30 87 33 474 122 
? Reserve Midshipmen's 
School (WR) 316 8.5 125 33 11.8: 32 55.5 10.9 


3 Reserve Midshipmen's 


School (WR) 8.6 13.2 3.0 11.5 32 56.9 10.8 


casier for the men. The biserial correlation coefficients between item 
and subtest were generally lower for the women. In view of all these 
differences, separate norms were reported for the women. 
RELIABILITIES AND INTERCORRELATIONS, OFFICER QUALIFICATION 
Est, Forms 2 лмо 3. The reliability coefficients of the subtests and 
Of the total test are shown in Table 4-vu. The coefficients of the new 
Orms were estimated in two ways: first by correlating the scores on 
Form 2 versus Form 3 where the same persons, taking the experi- 
mental form (O-2), answered the items of both forms. Second, the 
reliabilities were estimated on the basis of the correlations of odd- 


TABLE 4уц, Officer Qualification Test, Forms 2 and 3. Reliability 
coefficients of subtests and total test 


Alternate-Form Odd-Even (Corrected 
(Correlation between by Spearman-Brown 
Forms 2 and 3) Prophecy Formula) 


National Sample 
Indoctrina- Reserve Midship- 


Subtest tion School men’s School (WR) Form 2 Form 3 
^ o Eol с M В 
Opposites 92 90 91 90 

chanical Co ensi 75 50 74 78 

Arithm а Comprehension 88 
al Reasoni 5 78 83 i 

otal Test 7 82801106 А 87 91 91 
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numbered versus even-numbered items. By either method of ee 
tion, the reliabilities of the total test and of the Opposites su cae 
were very satisfactory. The reliability of the Arithmetical ea i 
subtest as computed by the split-half method was — 4 
ceptable, and the reliability of the Mechanical Comprehension а 
test was not considered satisfactory. Because of this low reliabi њи 
and the lack of information about the differential validities of the 
subtests at the time the decision had to be made, it was deemed ad: 
visable to report total scores only on the Officer Qualification Test 
instead of reporting separate scores for the subtests. 

The reliability coefficients of all the subtests, particularly of Me- 
chanical Comprehension, were higher for the men than for the 
women, as is shown in the alternate-form correlations. u | 

The difference between the two types of estimate of reliability e 
the Arithmetical Reasoning subtest is rather considerable (.83 vs. 
:76). The higher estimate obtained from the split-half correlation 

- indicates that the attempt to match the items of this subtest in 
Forms 2 and 3 was not completely successful, although the use of Gua 
different samples may account for some of the difference between the 
two coefficients. 


à " 3 are 
The intercorrelations among the subtests of Forms 2 and 3 a! 
А ee ore 
shown in Tables 5-уп and 6-vrr. The correlations in Table 5-уп we! 
computed for the 


f " s - Forms 
items of Form O-? which were retained for For? 
2 and 3. Since the candidates at the 


women's reserve midshipmen's school to 
was possible to correl 


3. It can be seen that, 


: np d 
indoctrination school aní 


correlate lower than the men’s. 


. . 25 
Table 6-vrr shows the intercorrelations based on national sample 


" ns 
or Form 3. The intercorrelatio” 


z Sa h 
ctrination school sample. In bot 
cases, the Opposi i 


prehension lowest, with the total test score. 


i ABLE 5-vu. Officer Qualification Test, Forms 2 and 3. Intercorrelations of subtests and total test in Indoctrination 


School (Men) and Reserve Midshipmen's School (WR) 


Subtest 
Mechanical Arithmetical 
Comprehension Reasoning "Total Test 
Indoc. Reserve Midship. Indoc. Reserve Midship. Indoc. Reserve Midship. 
School School (WR) School School (WR) School School (WR) 
Subtest Form 2 3 2 3 2 3 2 3 2 3 2 3 
Opposites 
Indoctrination School 2 23 J8 30  .34 88  .82 
3 23 .22 31 85 83 .89 
Reserve Midshipmen's 2 14 12 19 19 88 .80 
School (WR) 3 13 10 .20 21 .80 89 
Mechanical Comprehension 
Indoctrination School 2 43 .44 61 51 
3 41 46 49 58 
Reserve Midshipmen's 2 .38 .40 52 .36 
School (WR) 3 31 34 39 A6 
Arithmetical Reasoning 
Indoctrination School 2 62 .55 
3 59 65 
Reserve Midshipmen’s 2 55 46 
School (WR) 8 


48 .56 


[|2uuosaoq VPO 
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TABLE б-уп. Officer Qualification Test, Forms 2 and 3. Intercorrelations, 
means, and standard deviations (raw scores) of subtests and total test, 
national samples. (Form 2, N = 561; Form 3, N = 574) 


Subtest 
Mechanical Arithmetical В 
Opposites Comprehension Reasoning Total Test 
Subtest Form 2 Form 3 Form2 Form3 Form? Form3  Form2 Form? 

Opposites LET 39 37 3787 

Mechanical r 
Comprehension 53 А4 .65 60 

Arithmetical 

Reasoning 70 69 
M 26.98 2750 — 1896 1777 1159 1150 5680 5677 
c 1005 10.04 435 — 474 3.89 403 1460 1436 


made possible a study of the extent to w 
be predicted from scores on the test. Such a study of the validity 
of the test differs in Several respects from the usual validity study: 
and might better be considered a pre-validation of the Officer Quali- 
fication Test. In the usual method of validating a test, the finishe¢ 
form is administered to a group before they enter the work or trail 
ing against which the test is validated. In the present instance, the 
test Was given to persons already in training. Also, it was given 1” 
experimental form, which differed from the finished test in that it 
contained a large number of items not used in the Яна] Forms 2 апа > 
і ances, and in three sessions. Th 
г those circumstances may there 


i ; г the 
; would be о! d under 
usual circumstances, obtaine 


А а 
hich school grades coul 


- of 
cre divided into a number id 


Which consisted of several subjects. Det! vs 
: Obtained for each of the persons tested, and em 
ith test scores, The courses taught at the indoct 


дос 
"an 
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RELIABILITY OF SCHOOL Grapes. The course grades at both schools 
were fairly reliable (.75 to .92), with the exception of the communi- 
cations course at the women's reserve midshipmen’s school. The 
reliability coefficients for this course were attenuated by the fact that 
grades in very dissimilar subjects were correlated to determine the 
reliability of the course grades. 

CORRELATION WITH ScHooL Gnaprs. The Officer Qualification 
Test correlated with the final average grade at the indoctrination 
school to a serviceable degree (.50). A zero-order coefficient of corre- 
lation of this magnitude indicates a useful validity for the test in the 
Selection of candidates for indoctrination school. 

The correlation coefficients of Officer Qualification ‘Test scores 
with the final weighted average grade at the women's reserve mid- 
shipmen’s school were somewhat lower, ranging from .33 to 47. The 
lower validity of the test at this school was due partly to the lower 
reliabilities both of the subtests of the Officer Qualification Test and 
of the grades. Because of the relatively low validity of this test, the 
Use of a test with somewhat different content was considered for use 
in the selection of waves officers. " 

MULTIPLE CORRELATIONS OF OFFICER QUALIFICATION Tesr Sus- 
TESTS wir Grapes. There are several ways of making a test more 
valid for predicting a particular criterion. Among these are: 


l. To increase the reliability of the test. 
2. To change the weighting of the parts of the test. 
- To change the content of the test. 


An increase in the reliability of a test in order to improve its 
validity is desirable and, in the present instance, was possible. In 
Order to obtain a substantial increase in the validity of the Officer 
Qualification Test, it would need to be considerably longer. Further- 
more, a good deal of change would have to be made in the Mechani- 
cad Comprehension part, by lengthening and purifying this subtest 
%0 as to make it more homogeneous. In view of the variety of dif- 
‘rent mechanical situations which naval officers are called upon to 
ace, however, it was deemed inadvisable to eliminate any of the 
Physica] principles illustrated by the items in the Mechanical Com- 
Prehension part of the Officer Qualification Test. But only one hour 
Was available for testing at offices of naval officer procurement and 
the length of the test was consequently limited. Because of these 
actors extensive revision of the test did not seem to be feasible. 
, The maximum improvement which could be expected from alter- 
Ing the weighting of the subtests of the Officer Qualification Test 


AT ee 
с For a More detailed discussion of the validity of the Officer Qualification Test, see 
hapter X, 


96 Basic Tests 


can be ascertained by computing the multiple correlations ut ves 
three part-scores with the criteria and comparing these wine pcs 
with the correlations between the scores on the total test and th 

criteria. The multiple correlations were higher than the correlations 
of total scores with final grades by amounts ranging from .03 to De 
Increments of this size are desirable, but in view of the thousands 
of men tested in many centers in a comparatively short time, and of 
the risks of computational errors in 
decided that predictions of su 


ary training it was thought 
nal content. 


Experimental Studies of the Officer Qualification Test 


During the development of the th 
cation Test, and in certai 
wide use, studies were 
information. 


ree forms of the Officer Qualifi 
n cases after the tests were put into но 
performed in order to obtain additiona 


Office of Naval Officer Procure- 
an unlimited time for its com 


Time N M E 
Subtest 
Opposites 14 hrs. 500 32.28 a z 
. Unlimited H 
Mechanical Comprehension ly, hrs. Es es 
. . | Unlimited Г ut 
Arithmetica] Reasoning 1 1/5 hrs. мо 1 576 : a 
Unlimited 92 1751 : 
Total Test 11/, hrs, 500 66.54 E 
Unlimited 92 68.74 I" 
1 Values for unlimited time were 


f the 
calculated from grouped data; Һе ‘ 

У псе the sum 

Parts does not equal the mean for total score. 
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The effect of the time-limit, as shown in Table 7-уп, was slight 
and was confined mainly to the last part of the test, Arithmetical 
Reasoning. On the basis of the small effect of the time-limit on the 
standard deviations of the scores, it was concluded that the test func- 
tioned as a power test with the one and one-half hour time-limit. 

STABILITY or Items IN OFFICER QUALIFICATION Tesr, Form 1 

RETAINED FROM OFFICERS’ SELECTIVE EXAMINATION (SE O-1). The 
experimental examination (SE O-1) was given at the New York Office 
of Naval Officer Procurement, and on the basis of an item-analysis of 
the results, Officer Qualification Test, Form 1, was devised. It was 
decided to determine the stability of the items of the experimental 
€xamination which were retained for Form 1, when administered to 
à new sample taken from the same population. For this purpose, 
а Sample of answer sheets of Form 1, administered at the New York 
Office, was compared with those obtained in the administration of 
the €Xperimental examination at the same office. The items common 
to both tests were compared with respect to difficulty (p) and item- 
subtest correlation (тыз). 
А Statistical means were used to evaluate the significance of changes 
1n the difficulty on item-subtest correlation of all items from the first 
ta the second administrations. The chi-square test was used to deter- 
mine whether an item changed significantly in difficulty from one 
test to another. The difference in n, on the two administrations 
Was compared with its standard error, and the size of the ratio was 
"sed to judge whether or not the change was significant.’ 

In both difficulty value and biserial correlation coefficient the 
changes in the values of the items were small and for the most part 
not significant. It was concluded that the items retained for Officer 
Qualification Test, Form 1, were satisfactorily stable. 

Data were available on 74 items common to both tests. Twelve of 
these items changed in difficulty by amounts significant at the one 
Per cent leve] (five opposites, four mechanical comprehension, three 
arithmetica] reasoning), ten being more difficult in Form 1, as might 

€ expected from the more severe time-limit. Of the 74 biserial corre- 
ation coefficients between items and their subtests, eight changed 
Significantly at the one per cent level, with the general trend toward 
slightly lower correlations in Form 1. 

Comparison or New York AND NATIONAL SAMPLEs, OFFICER 

QUALIFICATION Test, Form 1. The preparation of the Officer Quali- 

Cation Test, Form 1, which was intended for use at all offices of 
Naval officer procurement, was based on an analysis of data from a 
Single office, New York. It was important, therefore, to determine 
whether the items functioned in the same way in the New York and 


" See Appendix E.1 for a detailed discussion of the techniques used. 
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the national populations. An analysis was made ofa random us 
of 500 answer sheets of Form | submitted by all offices of пети a 
procurement throughout the United States, and the pU eism 
compared with those obtained at the New York office. зе es 
parisons were made on the basis of item difficulty and item-su 
correlation. 

On the basis of the analyses it was concluded that the generally 
risky procedure of constructing a test for administration toa papse 
tion on the basis of an analysis of the results obtained from a sing : 
sample of the population was successful in the present case. Only 
eight of the 100 difficulty values and eleven of the biserial correla- 
tions were significantly different at the one per cent level in the two 
samples. The Opposites items appeared slightly easier, and Месһапі- 
cal Comprehension slightly more difficult for the New York sample. 
In general, the item-subtest correlation coefficients of the Opposites 
itefns were very slightly higher for the New York sample. 


TABLE 8-vir. Officer Qualification Test, Fori 
scores and standard deviations ( 
Indoctrination School) 


H an 
n O-2. Comparison of mea! 
raw scorcs) for samples of men (in 
, and women (in a Reserve Midshipmen's 


School [WR]) 
= sation 
Mean Standard Deviat! 
Subtest Men Women Men Women 
Opposites 71.0 78.9 20.3 "a 
Mechanical Comprehension 53.9 46.2 9.9 Bs 
Arithmetical Reasoning 32.8 30.7 7:8 б 


Comparison OF MEN AN 
Test, Form O-2. The e 
Forms 2 and 3 of the 
Was given as has been i 
trination school for 


D WOMEN ON THE OFFICER QuALIICATIO 
xperimental test (Form O-2) from whic? 
Officer Qualification Test were constructe 

ndicated to a number of students at an indoC 


men and at a women's reserve midshipmen § 
school. The means and standard deviations of the tests, and de 
difficulty values and biserial correlation coefficients of the items Rem 
compared for the two groups in order to determine the relative Ре 
formance of men and women on the test. 
The means and standard deviations of th 
8-vi. The women’s means were significantly 
higher (19% level) in Opp 


lower in Mec i 
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also showed sex differences, with the coefficients generally lower for 
the women, particularly in Mechanical Comprehension. In view of 
the differences in mean score and standard deviation on the tests, 
and of the differences in difficulty and biserial correlation of the 
items, it is clear that men and women indoctrinees did not perform 
in the same way on the Officer Qualification Test. 

Comparison or INDOCTRINATION SCHOOL AND NATIONAL SAMPLES, 
Forms 2 ахр 3. The items of Forms 2 and 3 of the Officer Qualifica- 
tion Test were chosen on the basis of an analysis of data from ad- 
Ministration of the items to already selected officer candidates at an 
indoctrination school. A study was undertaken to determine how the 
items performed for a nationwide sample from various offices of 
naval officer procurement. 

By a random selection, a sample of 561 candidates who had taken 
Form 2 and 573 who had taken Form 3 were drawn from the answer 
sheets submitted by all offices of naval officer procurement during 
а two-week period. To determine whether the items were satisfactory 
for nationwide use, the indoctrination school data were compared 
with the national data. 

Both in difficulty and in item-subtest correlation, the Opposites 
and Arithmetical Reasoning items were stable, but the Mechanical 
Comprehension items showed a number of significant changes. In 
general, the items of the latter subtest were easier and the correlation 
Coefficients higher for the national sample. In view of this fact it 
Was concluded that the preferable procedure would have been to 
Construct Forms 2 and 3 on the basis of analyses of data from a nation- 
wide sample of officer candidates. 

CORRELATIONS OF OFFICER QUALIFICATION TEST SCORES WITH AGE. 
Studies were made at the indoctrination school and women’s reserve 
midshipmen’s school to determine the relation of Officer Qualifica- 
tion Test scores to the age of student officers in these primary train- 
ing schools, The results are shown in Table 9-vrr. The correlation 
Coefficients of test scores with age were low at both schools, and were 
Mostly not significantly different from zero. There is an indication, 

OWever, that the older students tended to do somewhat better on 
the Officer Qualification Test, particularly the women; this was most 
noticeable on the Opposites subtest. . 2 

Evatuation. The Officer Qualification Test functioned satis- 
factorily as an aid in deciding whether or not an applicant was 
Potential officer material. It correlated quite well with subsequent 
grades in primary training schools and it gave evidence of being 
good measure of ability to profit from training. It therefore seems 
likely that the men and women who did not receive commissions 
at least in part because they had poor test scores would not have 
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been able to learn about and adapt to the Navy rapidly enough to 
make a real contribution to the Service. 


The Officer Classification Test 


The Officer Classification Test (OCT) was constructed in order to 
provide differential information for the classification of indoctrinees 


Taste 9-уп. Officer Qualification Test, Forms 1, 2, and 3. Correlation 
coefficients of scores with age in years of students in Indoctrination 
School and Reserve Midshipmen's School (WR) 


Reserve Midshipmen's 


Indoctrination School (WR) 
School Company 1, N = 152 
Class 6, N — 360 Company 2, N — 160 
Class 7, N — 403 Company 6, N — 115 
Form Class T Form Company T 
Subtest 
Opposites 1 6 -20 
1 36 
2 7 101 2 2 25 
6 31 
1 54 
3 7 101 3 2 25 
6 27 
Mechanical Comprehension 1 6 041 
1 021 
2 7 031 9 2 051 
6 05 ! 
1 01! 
5 7 051 3 2 023 
Р 6 — 26 
Arithmetical Reasoning 1 6 121 
1 15! 
2 7 —.031 2 2 06} 
6 2222 
1 143 
3 7 —.06 1 3 k A 
Total Test 1 6 20 P x. 
1 .52 
2 7 071 2 2 23 
6 18} 
1 2 
"з 7 071 3 f 25 
[6 106: 
Mean Age in Years 6 29.73 1 25.12 
7 297 [ 2 25.05 
Y [6 3010 
Standard Deviation 6 4. 1 3.74 
(Age in Years) ig | 2 3.21 
6 
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or midshipmen to facilitate their assignment to further training ог to 
specific ship or shore billets. Additional impetus was given to this proj- 
ect by a request from the Amphibious Training Command, Atlantic 
Fleet, for an instrument which could be used in the distribution to 
billets of officers in the amphibious forces. The content of the Officer 
Classification Test was determined with several considerations in 
mind. First were the results of factorial studies of mental organization. 
Second was the knowledge of what tests had been successful in the 
Navy on the enlisted level. Third was the experience gained with the 
Officer Qualification Test and other predecessor tests used with offi- 
cers, namely, the Pre-Radar Battery (described in Chapter VIII), and 
the Officer Mechanical Aptitude Test, experimental form. 

The tests of the Pre-Radar Battery and the Officer Mechanical 
Aptitude Test were to be used, however, in selection for specific 
Schools or billets, rather than for classification or distribution of 
Personnel to a wide variety of schools or billets. The problem in 
selection is to determine whether or not an individual is qualified 
10 serve as a member of an organization. In classification, the prob- 
lem is to determine, from the various aptitudes indicated by the 
tests, in which of several kinds of training or work an individual is 
Most likely to succeed. A classification battery must therefore pro- 
vide evidence of the varying levels of ability of an individual in 
different kinds of work. For this purpose, part-scores are recorded 
S¢parately and the scores оп the total test are either a series of num- 
bers or a graphic "profile." Because decisions are based on part- 
Scores and on the differences between part-scores, such a battery 
Tequires higher reliability and validity for each part than is necessary 
in a selection test in which no part-scores are reported. е 

The Officer Qualification Test did not provide differential in- 
formation regarding candidates, since only total scores were reported. 
It was partly because such differential information regarding various 
abilities was needed, that the decision was made to use a relatively 
untested experimental form of the Officer Classification Test while 
Evidence of its suitability accumulated as a basis for its revision. 

Until the end of the war, Form Х-1 of the Officer Classification 

€st was used for the purpose of classifying officers for assignment 

yond their indoctrination or midshipman training. During the 
use of Form Х-1, the need for various modifications became ар- 
Parent, and these changes were incorporated in the new Officer 
Classification Battery. The end of the war found this battery in the 
Process of development. " 

_ Description, The Officer Classification Test consists of four sec- 
tons: Verbal, Mechanical, Mathematical, and Spatial. The Verbal 
*ction contains 60 opposites items of the kind used in the Officer 
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Qualification Test. Since the opposites part of the Officer — 
tion Test was very reliable, and a larger number of these = сме 
included in the new test, the Verbal Section of the Officer Classific: 
tion Test was expected to be highly reliable. "ys uu 

The Mechanical Section of the Officer Classification Test has m 
subsections. The first is Mechanical Comprehension, with items e 
the same kind as in the Officer Qualification Test, but in gam 
number (45) in order to obtain a satisfactory reliability. The secon 
subsection, Electrical and Mechanical Information, intended to 
measure additional aspects of mechanical abilities, contains 45 е 
of the kind described in the previous chapter for the Mechanica 
Knowledge Test for enlisted personnel. : 

The Mathematical Section of the Officer Classification T est. gon 
tains 45 items of the same kind as the arithmetical reasoning items 


DESCRIPTION OF THE OFFICER CLASSIFICATION TEST 


Number Time Limits 
of Items in Minutes 


Part Total Part Total 


Part I. Verbal Section 


60 20 
Opposites 60 20 
Part II. Mechanical Section 90 30 
Mechanical Comprehension 45 20 
Electrical and Mechanical Information 45 10 
Part III. Mathematical Section 45 45 
Mathematical Problems 45 45 
Part IV. Spatial Section 60 35 
Block Assembly 30 15 
Rotation of Solid Figures 30 20 


in the Officer Qualification Test. The reliability of this part of the 
Officer Classificati 


nature of the j 


in factor studies of mental tests, 


Uses of the Officer Classification Test 


The Officer Classification Test 


ument 
certain 


- а 
Was developed in response ^s 
at reserve midshipmen's € 
operational training comman 
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Classification officers at these installations were faced with the task 
of recommending student officers for advanced training or billet 
assignments. These school and billet assignments could be roughly 
divided into three major categories: highly technical, e.g. radar 
officer; semi-technical, e.g. communications officer; non-technical or 
administrative, e.g. motor torpedo boat skipper. Tentative cutting 
Scores on appropriate sections of the test were established for the 
various schools and billets falling in these categories, and assign- 
ments were made, in part at least, on the basis of test scores. The 
procedures followed by the classification officers are described in 
Chapter II; the effectiveness of the Officer Classification Test in 
Predicting success of student officers in various types of training is 
discussed in Chapter XI. Validity data from some of the studies are 
presented in this chapter. 


Statistical Data on the Officer Classification Test 


Norms. The problem of constructing norms for the Officer Classi- 
fication Test was complicated by the fact that the test was intended 
for use with two officer populations, indoctrinees and midshipmen. 
There was no concrete evidence of the equivalence of these two 
Sroups with respect to test score. Owing to the differences in the 
average age of the two groups, it was anticipated that the midship- 
men might be slightly superior in mathematical and spatial ability 
and slightly inferior in verbal and mechanical ability. Previous 
Studies of the Officer Qualification Test and of the Basic Test Battery 
for enlisted men had indicated that mechanical and verbal test scores 
Correlated positively, while mathematical and spatial test scores 
correlated negatively with age, all to a slight extent. In view of this 
Possibility, it was decided that the norm group should contain a 
Sample from each population, and that the two should be combined 
if the data warranted the combination. РЕР 

Accordingly, the test was administered to 500 midshipmen ata. 
reserve midshipmen’s school and to 500 indoctrinees at an indoc- 
trination school. Slight differences were found between the samples; 
these were in the expected direction, but were so small as to be of no 
practical significance. The samples were therefore combined to form 
à norm group of 1,000. Four separate distributions were made for 
the four parts of the test, and four Navy Standard Score (NSS) scales 
Were derived from the respective means and standard deviations. 

he Navy Standard Score is based on a distribution in which the 
mean is assigned a scale value of 50 and the standard deviation a 
value of 10, When used in the classification process the Officer Classi- 


ication Test scores are expressed in this form. ` 
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MEAns, STANDARD DEVIATIONS, RELIABILITY COEFFICIENTS, AND 
INTERCORRELATIONS. Table 10-уп summarizes the data obtained from 
a sample of 250 of the norm group to which the Officer Classification 
Test, Form X-1 was administered. The table contains the means, 
standard deviations, reliability coefficients, and intercorrelations of 
the sections and subtests of the Officer Classification Test. An exam- 
ination of the table leads to the following observations. 

1. The locations of the means indicate the possibility of a slight 
skewness in the distributions. 

2. The intercorrelations among the sections of the test are suitably 
low for a classification test. The independence of the subtests, illus- 
trated particularly by the correlations of .08 between the Verbal and 
Mechanical Sections, and 02 between the Verbal and Spatial Sec- 


TABLE 10-уп. Officer Classification Test, Form Х-1. Means, standard 
deviations, intercorrelations, and reliability coefficients. 
(N = 250, proportionate sample of norm group) 


Reliability Coefficients 1 


Part Part Part Part 
Section of Test M? с І П WA ПВ IH IV IVA IVB 

Part I, Verbal 32.72 12.60 .92 
Part II, Mechanical 53.94 11.01 .08 .83 

A. Comprehension 26.88 6.23 12 85 .75 

B. Information 26.28 648 03 87 59 .74 
Part III, Mathematical 2377 6.79 24 .38 45 25 .78 
Part IV, Spatial 3712 856 02 34 43 .18 .38 181 

A. Block Assembly 20.64 3.97 04 31 40 .17 .37 .84 .55 


B. Rotation of Solid Figures 16,51 550 .00 .32 41 18 .36 93 62 .77 


! Reliability , coefficients were computed by the Kuder-Richardson Formula, No. 21. 
They are shown in bold-face type. 


? Means and standard deviations expressed in raw score form. 


tions, indicates the feasibility of using partscores in classifying 
officers. 

3. The reliability of the Mathematical Section (.78) is not as high 
as is usually considered necessary for а classification test. The relia- 
bility of the Mechanical Section (.83 


volume. 


First, there is the type of evidence which is exhibited by plotting 
the test profiles of certain groups successful in training for a give” 
type of billet by comparison with the average officer in the nor™ 
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group. Figure Туп shows three profiles of this sort, in which the 
units of measurement on the ordinate are Navy Standard Scores 
(NSS). It will be observed that each of these profiles differs from the 
others and from the Navy norm in a marked fashion. Especially 
noteworthy are the following facts: 

L. The pre-radar curriculum bristles with mathematics and theo- 
retical physics. The average officer who completes the pre-radar 
training is superior to 93% of the officers in the norm group on the 
Mathematics Section of the Officer Classification Test. у 

2. The curriculum in diesel engineering places a heavy emphasis 
Upon mechanical facility, and the average officer in this training 


-20 30 I П Lu Iv 
Verbal Mechanical Mathematical Spatial 


°——~+ Pre-Radar (P-R) 
о- - – о Communications (C) 
4x—- — Diesel Engineering (DE) 
Figure l-vii.. Profiles of mean scores of three groups on all sections of the 
Officer Classification Test. 


Scores at the 86th percentile of the norm group on the Mechanical 
*ction of the Officer Classification Test. 
фа Һе communications group, in agreement with expectation, 
St select with respect to verbal ability. The average graduate 
Communications school scored at the 69th percentile of the norm 
8тоцр on the Verbal Section of the test. 
hes ен type of evidence of validity may be derived from the 
ations of the sections and subtests of the Officer Classification 
“st with course grades in an advanced school (Submarine). Table 
уп contains data of this sort for the Officer Submarine School. It 
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The Officer Classification Battery is composed as follows: 


1 Verbal Reasoning Test 75 five-choice analogies items 
i mprehension 
Е к чи "— 48 five-choice mechanical compre- 
hension items . 
ПІ Mathematics Test 50 five-choice mathematics items 
IV Relative Movement Test 50 four-choice relative movement 
items 
У Spatial Test | : 
A. Block Assembly 30 four-choice block assembly items 
B. Block Rotation 30 five-choice block rotation items 


EvALUATION. In looking at the place of the Officer Classification 
Test in the testing programs of the Navy, the following summar) 
statements concerning it seem justifiable: The Officer Classification 
Test was useful in the distribution of indoctrinees and midshipmen 
to billets. Evidence indicates that it did differentially predict poten- 
tial school success, even within the very select groups referred for 
advanced officer training. Officer Classification Test scores were 
undoubtedly of considerable value to classification officers in a 
termining the broad general area within which each individua 
might be expected to perform most efficiently. 


College Qualifying Tests (C-Tests) 


purpose of the E 
was to select from all eligible candidates of high school educatio! 
or из equivalent, those men who w 


fully the training to be given them 


to more than 300,000 candidates for сој 
DESCRIPTION. The C- 


choice type, for the compl 


principal sections in the test, consisting respectively of verbal, scien 
tific, reading, and mathematical problems, 

Verbal Section. The verbal items were of three kinds: 30 opposites: 
15 analogies, and 15 double definitions, Opposites and analogie? 
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items have been illustrated in the preceding chapter. An example 
of double definitions follows: 


(3) heresy .. doctrine (4) heresy .. government (5) fascism .. 
government. 


Science Section. The scientific section consisted of 40 problems 
of a common-sense physics type. The technical training required to 
answer these questions was not great. For the most part intelligent 
Scientific interest and alert observation would be as valuable as aca- 
demic training. An example of this type of item follows: 


The structure of an atom is analogous to that of (a) earth 
(b) the solar system (c) the human body (d) a dynamo. 


Reading Section. The third section of the test consisted of four 
Paragraphs of about 200 words each. Five questions followed each 
paragraph, and five answers were suggested to each question. The 
candidate was to choose the best answer. In this section the candi- 
date’s ability to understand and answer questions about relatively 
difficult material was under test. This ability is, of course, basic to 
Success in college. Three of the paragraphs dealt with economic and 
historical material, while the fourth was on biology. 

Mathematics Section. The fourth section of the test consisted of 
30 questions designed to test the candidate’s facility with numbers 
and required a background of elementary algebra and geometry. 

The 150 items which were selected for the final test were chosen 
from a large number which were analyzed with respect to difficulty 
and item-subtest correlation as explained in Appendix Е-1. 

А summary description of the test is presented below. 


anan ES T 


Number Time Limit 
Section of Test of Items in Minutes 
I. Verbal 30 
Part 1, Opposites + 


Part 2, Analogies 
Part 3, Double Definitions 15 


П. Scientific 40 30 
III. Reading 20 25 
IV. Mathematics 30 35 

150 120 


АНАА 
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Means, STANDARD DEVIATIONS, RELIABILITIES, Meme iig y 
Norms for the С-1 test were prepared from the answer и о e 
representative sample of 1,500 cases drawn from the popu — 
men from 17 to 21 years of age, inclusive. Evidence of the represer = 
tiveness of the sample is derived from the fact that the mean ena 
standard deviation of the scores on the test differed by only ver у 
little between the sample and the total group of the same range "4 
age. The test was scored as a whole when used for selection, but ue 
means, standard deviations, reliabilities and intercorrelations of the 
sections, as computed from the sample of 1,500 cases, are shown in 
Table 12-уп. 

The reliabilities of the Verbal Section and total test are seen #0) 
be satisfactory. The Reading Test, which had the lowest reliability 


TABLE 12-уп. College Qualifying Test (C-1). Means, standard deviations, 
reliability coefficients, and intercorrelations of sections and 
total test. (N — 1500) 


— 
Part of Test 
> t 
Verbal Science Reading Mathematics ‘Total Tes 
Part 2 
Verbal .931 59 15 65 9 ( 
Science 85 57 .66 F^ 
Reading .76 63 is 
Mathematics .87 88 
Total Test .96 
Mean Score 2 254 20.5 12.1 15.1 73.1 
Standard Deviation 119 74 43 55 218 


1 The figures in bold- 


1- 
face type are reliability coefficients calculated by the Spearmar 
Brown formula from th 


€ correlation of odd- and even-numbered items. items 
? Means and standard deviations are expressed in raw scores, i.e., number of i 
Correct. 


(.76), contained on 
between 42%, and 
standard deviations 


ly 20 items. The mean of each section is locate? 
6195 of the maximum possible score, and t^ 
are adequately large. 


The intercorrelations among the sections of the test are sufficiently 
low, with one exception, 


different abilities, The ex 


equally with all of the other sections. 
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USE or THE Теѕт IN SELECTION. Since the Navy accepted men for 
its college training program on the basis of a quota proportional to 
the population of each state, the critical test score for acceptance varied 
from 75 to 106, depending on the number to be accepted from each 
State. After receipt of the record sheets of the men whose scores were 
within the eligible range, the Navy notified those men of their suc- 
cess on the test. In addition, the records of all men with scores of 
75 or more were sent to the offices of naval officer procurement and 
the district quotas were adjusted so that the Navy could avail itself 
of the candidates with good ability who would otherwise have been 
eliminated by the exceptionally high critical scores in their districts. 
In this way all men who made a score of 75 or better, regardless 
of their districts, actually received consideration for the college 
training program. ^ 

The success of the C-test in the selection of candidates for the 
college training program is discussed in Chapter X, together with 
the evidence on which the evaluation of the test is based. 


Usefulness of Basic Tests for Officer Personnel 


. The tests discussed in this chapter have served a useful purpose 
in the selection and classification of officer personnel. It will be shown 
in Chapter VIII that there was little need for special aptitude tests 
in classification after the Officer Classification Test came into general 
use. Success in the type of training undertaken by naval officers can 
be predicted best by tests of verbal, mechanical, and mathematical 
ability; spatial tests seem to have less applicability. In considering 
ап officer's qualifications for various types of training or billet assign- 
ments, it is almost always helpful to have information concerning 
the abilities measured by the Officer Classification "Test. It seems 
desirable, therefore, to have these scores for all officers in the Navy. 
The new Officer Classification Battery will have the additional ad- 
Vantage of providing a score on the Relative Movement Test which 
Was found to predict success very well in certain types of training. 
With these test scores it should be possible to predict with a reason- 
able degree of success how well most officers will succeed in ad- 
vanced training and subsequent billet assignments. 


CHAPTER VIII 
SPECIAL APTITUDE TESTS 


Tue basic selection test batteries for officer and enlisted personnel 
described in Chapters VI and VII were developed to measure ide 
tain of those qualifications which are required for success in a W = 
variety of naval training schools, Navy jobs, and shipboard billets. 
Partly because of the highly specialized character of the abilities 
quired for success in certain of these programs, and partly because еч 
basic test batteries were not developed early enough, special aptitude 
tests were constructed. 

The Radio Code Test used in the Navy is illustrative of the type 
of test developed to measure a specialized type of aptitude. раније 
in radio schools has always been higher than in most other types 0 
training for enlisted personnel, and the original tests of the basic 
battery were found to be relatively poor predictors of ability to learn 
the code. The Radio Code Test—Speed of Response was accordingly 
developed to assist in sc 
ability in order to reduce the failure rate in radio schools. 

The CIC (Combat Information Center) Aptitude Test is illustra- 
i need before a basic compre 
hensive test battery had been developed. At the time that the tactical 
radar school for officers was established, the Officer Qualification 


the officer level standardize 


Ot measure certain aptitudes 
ining. As a result the speci? 
· After the Officer Classification 
prediction of success in Gu 
$ satisfactorily with the Mathe 
CIC Aptitude Test. When th 


mpletely replace 
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under Group I have been widely used in selection and classification 
of naval personnel and their usefulness in predicting success has 
been extensively studied. The tests listed in Group II have, in gen- 
eral, received rather limited use and as a result have not been 
studied as intensively as those in Group I. The Sonar Pitch Memory 
Test is placed in Group II because studies of this test have been 
made by the National Defense Research Committee rather than by 
the Bureau of Naval Personnel. 


Group I Tests 


Tue CIC (COMBAT INFORMATION CENTER) APTITUDE Trsr. When 
the plans for opening the tactical radar training school were com- 
pleted in late 1943, the Test and Research Section was asked to 
develop a test for use in selecting candidates for this school from 
graduates of indoctrination and reserve midshipmen’s schools. Anal- 
ysis of the job of the tactical radar officer and of the tactical radar 
curriculum indicated that the following abilities would be required: 
(1) quickness of judgment, (2) speed and accuracy of plotting, and 
(3) quick visualization of the tactical situation. In addition it was 
believed that a high level of mental ability (to be measured by the 

fficer Qualification Test) would be necessary in order to compre- 
hend, coordinate, and administer the complex activities of a combat 
Information center. The result was the preparation of the Tactical 
Radar Aptitude Test Battery consisting of four subtests: Polar-Grid 
Coordinate, Ratio Estimation, Coordinate Reading, and Relative 

ovement. These tests were originally developed by projects under 
the National Defense Research Committee. 

, Follow-up studies of the early classes in tactical radar training 
disclosed that the Ratio Estimation and Coordinate Reading Tests 
Were of little value in predicting success; the Polar-Grid Coordinate 
and Relative Movement Tests gave promise of being useful if revised 
to eliminate certain defects, notably that too much time was allowed 
to complete the tests and that the Relative Movement Test was too 
Short to provide a reliable score. Since a Scale Reading Test, devel- 
Ореа by a National Defense Research Committee project had been 
found effective in predicting the success of radar operators (enlisted 
Personnel charged with the operation of radar gear) it was decided to 

uild a Combat Information Center Aptitude Test consisting of 
three Parts: Polar-Grid Coordinate, Scale Reading, and Relative 

Ovement. The test is of the multiple-choice type and uses a 
fol пе-зсотаћ]е separate answer sheet. A description of the test 
ollows; 
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Number Time in 
Test 1. Polar-Grid Coordinate of Items Minutes 
Items in this test require that the examinee read 
a point on a polar chart and then translate this 
reading to a point on a grid chart 45 13 


Test 2. Scale Reading 


The test consists of a wide variety of scales with an 
arrow pointing to a certain point on the scale. 
The examinee must note carefully the units into 
which the scale is divided and make a best esti- 
mate of the point on the scale at which the 
arrow is placed 60 12 


Test 3. Relative Movement Test 


This test contains items designed to measure the 
ability to visualize the relative movement of 
ships, involving the determination of direction, 
distance or speed of ships. Basically the test ap- 
pears to be a measure of spatial relations ability 
but presents problems in a navigational setting 45 25 


Total 


STANDARDIZATION. The СІС Aptitude Test was standardized by 
administering it to a population of 860 midshipmen. The average 
raw score in the test made by this group is 75.96 and the standard 
deviation is 15.05. When administered at the tactical radar training 
school to a group of 307 students, a mean raw score of 95.43 an 
standard deviation of 20.27 were obtained. In other words, th¢ 
average student in tactical radar training is more than one sigma 
above the mean of midshipmen. 

INTERCORRELATIONS. The intercorrelations of the subtests and the 
correlation coefficients of each part with the whole, computed fron 
the scores made by 118 students enrolled in a single class in tactica 
radar training, are presented in Table 1-уш. The data indicate Ша! 
while there is substantial relationship among the parts of the CIC 
Aptitude Test, they appear to measure somewhat different facets ° 
the total ability measured by the test. 

Кеглавилту. Kuder-Richardson reliability coefficients, determined 


for barh tactical radar and midshipman populations are show? in 
Table 2-уш. Contrary to what 


| one might expect, the tactical rac 

Pisis. женине has a larger standard deviation than the m!€ 

Р tt epe € parts of the test as well as on the total. A much larg? 
number of high scores was made by the tactical radar students, 
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а few very low scores were also made. Since the tactical radar school | 
received some unscreened students from ships and shore stations in 
addition to those selected from indoctrination and reserve midship- 
men's schools, this wide range of talent is not surprising. 


Taste Туш. Part-whole and interpart correlation coefficients for the 
CIC Aptitude Test. (N = 118) 


Test Part 
А Polar-Grid 
А Гем Coordinate Scale Reading Relative Movement 
Part И 
Scale Reading 69 
Relative Movement 55 53 
Total 87 .88 78 


Variprrv. Complete data on the relationship between CIC Apti- 
tude "Test scores and success in training of tactical radar and fighter 
director officers are presented in Chapter XII. Briefly, for tactical 
radar officers the correlation coefficients ranged from 45 to .56 and 
for fighter directors (Naval Radar Training School) from .42 to .55. 
Modifications of the three parts of the test were administered to a 


Taste 2-уш. Reliability coefficients ! for the parts of and the total 
CIC Aptitude Test 


n 
Sample 
Reserve Tactical Radar 
Midshipmen Student Officers 
~ Test (N = 860) (№ = 307) 
Part ч f 
Polar-Grid Coordinate 67 85 
Scale Reading 74 85 
Relative Movement 70 82 
» Total 84 92 


1 : 
Kuder-Richardson formula, No. 21. 


Class of 126 radar operators (enlisted personnel). Correlation coeffi- 
cients for this population between scores ОП Parts 1, 2, and 3 of the 
test and final grades were .40, .46, and .24, respectively. The Relative 
Movement Test in modified form was found by a project of the 
National Defense Research Committee to correlate .41 with success 


ú p. 
П training of sonar officers. 
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EvaALvATION. The CIC Aptitude Test has —— pe «ip: 
in predicting success of officers in training for tactica oa 
fighter director billets. It also appears likely that the Е vate 
be effective in predicting success in training of sonar officers. | picis 
radar, fighter director, and sonar officer billets are operated та = 
than technical in character, requiring quickness of Judgment a d 
the ability to visualize a tactical situation. For the purpose of ic pem 
fying those individuals most likely to succeed in these training p 


. сео i iderable 
grams, the CIC Aptitude Test would seem to possess considerab 
5 
merit. 


Pre-Radar Officer Aptitude Test Battery 


The supply of officers with a civilian electronics engineering cn 
ground of a caliber to qualify them for direct commissioning as radar 
specialists was exhausted in the early months of the war. Thoreau 
it became necessary to select from general officer candidate a, 
those men who, in terms of ability, educational background, an А 
interest, gave most promise of succeeding in the training program for 
radar officers. For this purpose a battery consisting of a special apt 
tude test and achievement examinations in gener 
eral mathematics was constructed for 
of midshipman training. 

An experimental form of the battery w 
3,411 midshipmen at three reserve midship 
population a representative sample of 400 
for statistical analysis. In general, items which were retained in the 
final battery discriminated between individuals whose total test 
scores were in the upper 27 per cent of the sample and individuals 
with total scores in the lower 27 per cent. 


The tests of the Pre-Radar Officer Aptitude Test Battery as finally 
developed are as follows: 


al physics and gen 
administration to graduate 


as first administered tO 


i is 
men’s schools. From ri 
test papers was selecte 


Number Time in 
Name of Test ofltems Minutes 


Pre-Radar General Aptitude Test 
Part 1, Mechanical Aptitude 


57 30 

Part 2, Number Series 30 15 
Part 3, Analogies 50 30 
Total 137 75 


General Physics Test 70 90 
General Mathematics Test 45 75 
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STANDARDIZATION. The tests comprising the pre-radar battery were 
not standardized in the conventional sense. The chief purpose in 
giving the tests was to identify the upper end of the distribution of 
scientific ability, Final selection was based upon interview data and 
a careful evaluation of the candidate’s educational and vocational 
background. A cutting score in raw score form was found to be 
satisfactory in this selection process. 
| RELIABILITY. Kuder-Richardson coefficients of reliability for the 
Pre-Radar General Aptitude Test, General Physics Test, and Gen- 
eral Mathematics Test and for the total battery are .83, .76, .67, and 
‘87, respectively. These coefficients were based upon the scores made 
by 3,007 general duty midshipmen in training at three reserve mid- 
shipmen’s schools, the type of population to which the tests were 
administered in the selection of officers for pre-radar training. 


Taste З-уш. Means and standard deviations for the Pre-Radar Officer 
Aptitude Test Battery administered to general duty and 
specialist duty midshipmen 


Test 
Pre-Radar 
General General General Total 
Midshipman apura - К Physics Mathematics : Battery 
Group N M m M с M o M с 
epecialist 404 947. 157 42 106 948 74 163.6 — 98.6 
eneral — 3,07 874 133 280 — 82 183 5.6 134.9 920 


Vauiprry. Validity studies of the Pre-Radar Officer Aptitude Test 
attery are of two general types: 


l. Studies showing differences in average test scores of scientifi- 
9 cally and non-scientifically trained individuals, and 
& Studies showing the relationship between the test scores and 


Success in pre-radar training. 


The first type of study is illustrated by the results obtained by 
administering the test battery to 3,411 midshipmen at three reserve 
Midshipmen’s schools. Of the total sample there were 404 men 
who were classified as specialists by virtue of their having had pre- 
Vious studies of a scientific nature. The remaining 3,007 men were 
Classified as “general” and were being trained for general deck duties. 
Comparison of the mean scores of these two groups on the Pre-Radar 

сег Aptitude Test Battery as shown in Table З-уш, shows а 
distinct superiority favoring the specialist group and, in a sense, 
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indicates the validity of the examinations. All differences аге in 
favor of the specialist group and are well above the one per cent 
level of statistical significance. | с. а 

The second type of validity evidence is illustrated by the study 
made of the relationship between Pre-Radar Officer Aptitude der 
Battery scores and success in pre-radar training as measured by fina 


grades. The correlation coefficients obtained in this study, for 120 
cases, are as follows: 


| Test т 
Pre-Radar General Aptitude 09 
General Physics 54 
General Mathematics 48 
General Physics and General Mathematics -59 
Pre-Radar Officer Aptitude Battery (Total) 45 


From these dat 


a it will be noted that the Pre-Radar General Apti- 
tude Test was 


the least efficient test of the battery. In fact, when 
combined in a multiple score, its erratic predictions had the effect 
of lowering the correlation coefficients which were obtained by the 
use of either one of the other two tests by itself. As might bé € 
pected, the General Physics Test was the best single predictor, since 
so much of the training course is based upon this subject Ma 
Actually, the 120 cases in the above sample represent a restrictcc 
range of talent since original selection took place at reserve midshtp* 


à a А с 
men's schools and further personnel attrition occurred during th 
four months pre-radar course. 


EvALUATION. The Gener: 
of the Pre-Radar Officer i 
effective Instruments in t 


cess in training of pre-radar officers is inde 
55 of “general” tests in the selection of candi 
t training. The General Physics and Gener? 
Mathematics Tests, which are in reality achievement examination® 
€ as selection devices at this level of ability: 


The Radio Technician Selection Test 
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To insure the maintenance of personnel quality the Radio Tech- 
nician Selection Test, in large part a measure of achievement in 
radio materiel, was developed. As the supply of men experienced in 
radio diminished, and it became necessary to select for training from 
the general population, the early forms of the Radio Technician 
Selection Test decreased in validity. The present series, Forms 6A, 
7A, 8A, 9A, was consequently developed to meet the very real need 
for identifying those individuals who, although lacking in practical 
experience, possessed not only the necessary mental ability, but also 
enough of a previous background and interest in scientific subject 
matter to have become familiar with many of the elementary electri- 
cal and radio concepts. Each of the presently used forms of the Radio 
Technician Selection Test has the following content: Mathematics 
—20 items; General Science—20 items; Shop Practice—10 items; Elec- 
tricity—15 items; Radio—15 items. Each item in the Mathematics 
Section is given a weight of two points; the other items count one 
point, for a total score of 100 points. The test has been administered 
both in recruiting stations and in naval training centers, with a 
Single time limit of 75 minutes. 

STANDARDIZATION. Since the purpose of the Radio Technician 
Selection Test has been to identify those men in the upper 25 to 
30 per cent of the enlisted population who could master the radio 
Materiel course, the chief object of standardization of each form has 
been to establish a suitable cutting score rather than to establish 
norms of performance for enlisted men generally. This objective has 
been accomplished by administering the new form and an old form 
(Previously standardized) to a population of 500 or more men who 
Vere candidates for radio materiel training. These men were selected 
On the basis of their scores (Navy Standard Score of 55 or above) in 
the General Classification Test, Arithmetical Reasoning Test, and 

lectrical Knowledge score of the Mechanical Knowledge Test of the 

asic Test Battery. In order to neutralize practice effects, half of the 
Men took the old form first, followed by the new form, and the other 
half of the men took the tests in reverse order. 

The distributions of scores for the new form and old form ad- 
Ministered to the same population made possible the equating of 
"aw scores and the establishment of a comparable cutting score for 
Киа form. Three ranges of cutting scores were established for 

ch form... i e Шпе range and an in-between or 
alternate rang, Records er Johann 1- in the alternate range were 
Evaluated to determine whether the individuals possessed contribu- 
tory background factors which might insure success in training even 
though aptitude test scores alone did not indicate a high level of 
Potentia] achievement. All forms now in use have been equated and 
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comparability carefully established so they may be used interchange- 
y ЕИ AND COMPARABILITY OF Forms or THE Trsr. Kuder- 
Richardson reliability coefficients of the various forms, based pa 
representative samples of naval enlisted personnel, ranged from. 9 
to .95. Coefficients of correlation between the various forms adminis- 
tered under conditions equalizing practice effects ranged from .83 
to .89. 

CORRELATION WITH Basic Tresr BATTERY. In general it has not 
been feasible to study the interrelationship of the Radio Technician 
Selection Test with other Navy selection tests because trainee 
samples in the radio technician training program were so highly 
selected that the restricted ranges would result in correlation coef- 
cients spuriously low. Coefficients of correlation between scores on 
the Radio Technician Selection Test and scores on the basic battery 


TABLE Фуш. Correlation coefficients between scores on the Basic Test 


Battery, Form 3, and the Radio Technician Selection Test, Form 9A, 
for an unselected sample of Regular Navy recruits, (N = 534) 


Test T 
Reading 54 
Arithmetical Reasoning 59 
Mechanical Aptitude 47 
Mechanical Knowledge (Mechanical Score) 37 
Mechanical Knowledge (Electrical Score) 54 


ruit 
» however, for an unselected sample of recruit 


е 
t regular Navy after the surrender of Japan. T 
correlation coefficients (Table Фупт) may be considered represent? 


pa : e 
t that the ability range of the recruit samp! 
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fe и amd the lower 75 to 80 per cent of the total recruit 
tone a and of this: remaining group, approximately 25 per cent 
eres uring the first month of instruction (Pre-Radio Materiel 
R ool). In the succeeding three months (Elementary Electricity and 
Haeo Marie School) another 7 to 10 per cent were lost. Correla- 
nd icients must, therefore, be interpreted in the light of this re- 
both eas, 7 For one sample of 437 men who were tested with 
асаан " and ТА of the Radio Technician Selection Test, the 
Bad: omeni correlation coefficients with Form 3 of the Pre- 
tively, Maine Аснои Examination were .31 and .57, respec- 
ТА (for | e етен coefficients between scores on Forms 6A and 
ins а group of 165 men) and scores on Form 4 of the Elementary 

‘icity and Radio Materiel Final Achievement Examination 


Were .34 and .44, respectively. 


TABLE 5 = 
Æ 5-уш. Means and standard deviations for the Basic Test Battery, 
Form 3, for Navy inductees and Regular Navy recruits 


Inductees Tested Regular Navy 
February through Recruits Sample 
August 1945 Tested October 

(N = 260,000) 1945 (N = 534) 

E Test Mean с Меап с 
Ready Саву сапоп 5199 — 1185 4951 9.70 
Arithmetica] 5351 1258 5095 10.93 
Mechanica a Кеаѕопіпр 51.62 12.40 48.01 10.44 
echanical АРЧЫ 52.77 9.26 52.47 8.92 
echanica] ye две (Mechanical Score) 49.80 9.86 47.44 8.76 
nowledge (Electrical Score) 51.86 10.59 48.54 8.75 


ааыр, The Radio Technician Selection Test has been of 
ability Prae in identifying those individuals in the upper levels of 
ör ade enlisted men who by interest and aptitude were good risks 
needed a materiel training. Since radio technicians were sorely 
à асц? the Navy it was necessary to select men who could master 
thar PR a in a comparatively brief span of time. The fact 
Bram ze ir was relatively small in the radio materiel training pro- 
rigorous] be attributed in part to the fact that the trainees were 
У screened by means of this test. 


The Radio Code Test 


E Radio Code Test—Speed of Response was developed for the 
desi pd Navy by the National Defense Research Committee. The 
attriti ОГ some type of special aptitude test was indicated by the high 

9n rate in radio schools and the fact that tests of intellectual 
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capacities consistently showed low correlations with — be 
ing in such schools. Since the reason for failure most 1 D iba 
mentioned by the staffs of radio schools was inability to lear APR 
code" it appeared that, if possible, a special aptitude test shou 
designed to predict code learning ability. . uk 

In developing the code aptitude test for the armed services, * m 
was undertaken on (1) discrimination tests measuring the ability of 
the subjects to distinguish between complex rhythmic patterns of 
dots and dashes, (2) code learning tests which measure the ability - 
the subject to learn code characters, and (3) speed of response sine 
which measure the ability of a person to identify a few code ee E 
at rapid rates of transmission, the subject being first taught a м 
code characters and being then tested on these well-learned арб 
ters at several faster code speeds. Theoretical considerations a! е 
exploratory studies indicated that the speed of response type of ii 
showed the greatest promise of being useful in predicting success i 
radio training and a test embodying this principle was, ber 
developed. A complete account of this project has been presente 
reports of the National Defense Research Committee. . ao 

The form of the test adopted for use by the Navy consists of е 
parts, first, а learning unit in which the subjects are taught es 
code characters, and second, a testing unit in which the subjects 2 | 
tested at four different speeds on these learned characters. The не 
test is recorded on phonograph records and the examinee’s respon, H 
are recorded on machine-scorable answer sheets. Only the two high 
speeds, consisting of 75 items each, are actually scored. yas 

STANDARDIZATION. The Radio Code Test—Speed of Response мея 
standardized on a Navy recruit population and the raw scores и 
verted to Navy Standard Scores (mean of 50 and standard deviati 
10). The test is regularly administered to recruits at naval train! 
centers as a part of the Basic Test Battery, 


Vauinrry. Extensive validity data on the 
by the National Def 


pectively. If a cutting $ op 
9n the Radio Code Test had 
o-thirds of the failing students 
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Evatuation. The Radio Code Test—Speed of Response has 
demonstrated its value in the selection of candidates for radio school. 
Through its use it has been possible to identify more clearly those 
individuals who, while they might be only average in general mental 
ability, possessed special ability to learn the code. While the test did 
Not reduce failure rate in radio schools to the low percentage found 
11 most other enlisted elementary schools, it did constitute a distinct 
Improvement over the original tests of the Basic Test Battery as a 
Selection device. 


Group II Tests 


THE Sonar Рітсн Memory Test was developed for the Navy 
Under the direction of the National Defense Research Committee. 
he test is basically similar to the Seashore Pitch Test but contains 
certain improvements which make the test more similar to the actual 
Job of a sonar operator and which also increase its reliability. The 
test was standardized on a population of Navy trainees all of whom 
had General Classification Test scores above 50 (Navy Standard 
Score). Substantial correlation coefficients with the doppler judg- 
Ment criterion have been obtained. The test has been used as part 
of a Selection battery to select sonar officers and sonar operators. In 
the Case of officers, the test has been given at reserve midshipmen’s 
Ог indoctrination schools or in operational training centers; enlisted 
tne take the test at naval training centers as a part of the нефа 
+ ction process, Complete reports describing the development о 
118 test and its validity have been published by the National De- 
ense Research Committee. 
5 HE WINCHMEN AND HATCHMEN SELECTION "Trsr was devel- 
и леци и use in the selection of winchmen and hatchmen for the 
hing program under the direction of the Operational Training 
©mmand, Pacific Fleet. The test consists of three parts as follows: 


“st I, Block and Pattern Assembly, 34 items; Test 2, Rotation of 


Solid р 4 hension, 40 
М igures, а к 3, Mechanical Comprehension, 
Items, ps s nu ru and 20 minutes, 


respe The time limits for the three parts are 15, 12, s га 
im sctively, The total score in the test is the number of item 
in -- ered correctly. Correlation coefficients with criteria of success 
con; tational training have been uniformly low; and when used in 
ru with the best tests of the Basic Test Battery, there is no 
ting increase in efficiency of prediction. 
HE Evg.HAwp Coorpination Tesr was developed also for use 
he winchmen and hatchmen selection program. The test is a 
mi Sure of speed and accuracy of serial reaction and consists of a 
65 ОЁ circles, connected by lines, which the examinee marks in 


“trial Order. There are 120 circles in the test and a time limit of 


in ( 
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60 seconds is allowed. A study of the use of the test in the E. 
of winchmen and hatchmen showed that the multiple corre пев 
coefficient obtained by use of the best combination of two See as 
the Basic Test Battery was not improved by the addition of this эч 
THE AIRPLANE MATCHING TEST was prepared from material т a 
nally developed by the Aviation Psychology Section, Bureau of M 
cine and Surgery, U. S. Navy. The test consists of plane silhoue 
partially covered by cloud formations, which the examince sd 
quired to match with the contour silhouettes of 14 types of p gs 
shown on a master chart. Eight minutes are allowed to complete 
test of 40 items. The score is the number of rights minus wrongs- f 
The test has been used at the recruiting level in the selection = 
combat aircrewmen as a supplement to the Basic Test Battery. pon 
study of the prediction of success in aerial gunnery school it eal 
found that the multiple correlation coefficient, using the Масша 
Aptitude, Mechanical Knowledge, and Reading Tests of the gen 
battery was .38; the addition of the Airplane Matching Test and fe 
Mechanical Comprehension Test (described below) raised gag 
cient to .41. Considering the present degree of refinement 1n а 
selection process, it does not appear that the addition of the Airplas 
Matching Test and Mechanical Comprehension Test to the ши 
Test Battery results in an appreciable increase in efficiency of рте 


tion of success, at least as measured by 


* : y 
grades in aerial gunnery 
School. 


5 of 
THE MECHANICAL CoMPREHENSION TEST used in the selection 


B : 2 х est- 
combat aircrewmen is the Bennett Mechanical Comprehension Te 


Since this test is adequately described in the literature, no descr! 
tion of it is presented here. al 

THE Ріст Memory Span AND SENTENCES ту Norse Tests, deV e- 
oped by the National Defense Research Committee, are of the T 
corded disc type and are used 1 


"n nO: 
centers. The Digit Mem, 
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up of 100 items consisting of questions, commands, and incomplete 
statements, for each of which four alternative words or numerals 
are given, one of which serves to complete correctly the stimulus 
sentence. The listeners answer by underlining the appropriate 
response. The test requires about 25 minutes and can be adminis- 
tered over earphones or a loudspeaker. The score in the test is the 
number right, 

. No studies of the validity of the Digit Memory Span or Sentences 
in Noise Tests have been conducted by the Bureau of Personnel. 
Complete descriptions of and statistical reports on the tests have 
been published by the National Defense Research Committee. 


Usefulness of Special Aptitude Tests 


On the basis of data gathered in the Bureau of Naval Personnel 
during World War II, it would be difficult to defend the extensive 
use of Special aptitude tests of the pencil and paper type in the selec- 
üon and Classification of naval personnel. Such basic classification 
batteries as the Basic Test Battery for enlisted personnel and the 

сег Classification Battery appear to be adequate for the testing 
Purposes to be served within the framework of the present rather 
unrefined selection and classification programs. The major excep- 
tons occur in the testing of personnel for selection for radio and 
Sonar training, where tests of intellectual and mechanical aptitudes 
ате inadequate. Special tests have also been useful in selecting officers 
and enlisted men at the upper end of the distribution of technical 
ability Гог such training programs as pre-radar and radio technician. 
In brief, Special tests ME a useful purpose when (1) the measure- 
ment of highly specialized aptitudes is required, and (2) when refined 
Measurement is required at a given level of ability. | 

It should ђе emphasized that the special aptitude tests studied by 
‘he Bureau of Naval Personnel have been predominantly of the 
Paper and pencil type. It seems likely that for certain billets, notably 
the artificer branch on the enlisted level, the use of performance 
tests might have resulted in greater efficiency of prediction. As selec- 
Hon and classification procedures as a whole are refined, it would 
арреаг that greater refinement in the aptitude testing area should be 
Sought by determining the usefulness of special aptitude tests of the 
Performance type for various billets especially in the artificer branch. 


CHAPTER IX 
MEASURES OF PERSONAL ADJUSTMENT 


A MILITARY organization cannot afford to harbor the quus pn 
individual. In a time of crisis his disintegration is apt to p oe 
disastrous panic by contagion. His failure of judgment or eet 
may prove the failure of a ship or an operation. His прете ime 
instability or lack of initiative may destroy the balance anc co eet 
tion which is the essence of a complex interdependent fighting ae 
Unless every man can be counted on to do his job under lee n] 
of battle, the efficiency of the whole fighting team will be impa ме 
Unfortunately the problem of eliminating psychoneurotic е 
psychotic elements from among the populations drawn 4 р 
armed services has proved both difficult and extensive. Analys dist 
the data gathered at the level of the local board and the induc pn 
center indicates that an average of 28 men per 1,000 have ae 
jected because of mental disease, not including 7 men per 1,00 det 
qualified because of mental deficiency. Further elimination ha dive 
nas been estimated that administra has 
hree per cent of all Navy pec ee 
grounds.! The extent of the pro the 
on contained in a joint letter pres 
cine and Surgery and Bureau of 1 wet 
Medical Officers to provide 35 beds P 


АЦА : K хсер 
as а psychiatric observation ward € 
es a lesser need, 


Роп psychiatric personnel. As the war P 
gressed, the problems 


more numerous, and psychiatri 
ters and receiving ships ass 


Personal adjustme 


use” is 
] ; nt described in this chapter were UO ¢hi 
ng devices,” this term wi 


. ae 
ill frequently be applied to them 
126 
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tienced clinicians were required to undertake the task of diagnosing 
and making recommendations with respect to millions of men and 
women. The goal was set as the development of objective test tech- 
niques suitable for group administration which would operate as an 
effective adjunct to the psychiatric screening process. 

Users AND MISUSES or THE SCREENING Trsrs. The primary function 
of the screening tests developed in the Navy has been to select that 
Segment of the total population in need of referral for psychiatric 
Investigation. The tests must therefore be considered adjunctive 
Instruments and do not usurp the functions of the psychiatrist. Only 
under very special circumstances have measures of personal adjust- 
ment been permitted to operate as a direct means of elimination in 
the Screening process without confirmation through independent 
Clinical interviewing. In line with this thinking there has been a 
Benera] tendency to eliminate the use of the term "cutting score" in 
Connection with these tests and to substitute the terms "referral 
Score” or "investigating score." In some instances the tests have not 
even been used to restrict the population to be interviewed but made 
to serve primarily as an indication of the individuals to be examined 
most intensively. Under either circumstance, it should not be as- 
Sumed that interviews could proceed on the leisurely basis which 
characterized civilian psychiatry. The five-minute interview, at least 
for training centers and receiving ships, frequently represented an 
extravagant indulgence of time on a single case. Techniques for 
Broup interviews, in which a number of men were seen at one time, 
have been developed in several places. With or without the aid of 
Prescreening tests, rapid if not cursory evaluation remained a prime 
Necessity, 

This Situation points to a second important function of the paper 
апа репсі] questionnaire used in measuring personal adjustment. 

hile it is far from universally true, a great many interviewers have 
found that the data provided by such a test assisted materially in 
condensing the examination and pointing it in a productive direc- 
Чоп, Not only were the specific admissions concerning symptoma- 
tology Significant, but the subject’s variable reaction to the relatively 
Mpersonal test and to the face-to-face questioning of the psychiatrist 
often Provided important clues to areas of disturbance. 

his use of the test data as a basis for interviewing does not always 
Constitute an unmixed blessing. In the rush of events, when time was 
Short and Waiting lines of men long, the test might easily slant the 
Interview and even determine its whole nature. The examination 
might readily assume a rigid pattern of questioning wholly fixed by 

» Symptomatology covered by the test, or the test scores could be 
°vervalued in making a final disposition of a case. These disad- 
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vantages, however, are functions of the skill and flexibility of the 
individual examiner. Stereotyped and formalized approaches to a 
subject could also occur without the predisposing influence of test 
data. 

History OF RESEARCH IN THE BUREAU or NAVAL PERSONNEL ON 
PERSONAL ADJUSTMENT MEASurES. The mental health and stability 
of naval personnel is the practical concern of both medicine and 
personnel administration. For this reason, the Neuropsychiatric 
Branch of the Bureau of Medicine and Surgery and the Test and 
Research Section of the Bureau of Naval Personnel have maintained 
active liaison and engaged in a joint endeavor to reach a satisfactory 
solution of the problem of developing effective screening tests. While 
the psychologists assigned to the Bureau of Naval Personnel have 
assumed primary responsibility for actual research in test develop: 
ment and validation, cooperation by the psychiatrists and psycholo- 
gists assigned to the Bureau of Medicine and Surgery has been of 
the utmost value. 
est is seen in the fact that one of the 
the Personal Inventory, was installe 
mmendation of the Chiefs of the tW? 
es involving representatives of the tW? 
rse of the research on test development 
portance to the research program Вазе 
by psychiatric personnel in providing 
alidation of tests. Whatever progres? 
pment of effective screening tests stem? 
d interests and efforts of the represent? 
dicine and Surgery and the Bureau 9 


It should not be im 
of research 


the research which was undertake? ^ ,.. 
Y be characterized by the ? pis 


"too little » У 
and too late.” An explanation [07 те 


пађју clear. So man 
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Beyond that, the problem of personality evaluation is still one of the 
most perplexing on the psychological research agenda. It is not sur- 
Prising, therefore, that other pressing questions received prior atten- 
поп. 

These comments are injected here because the armed services, 
even after the termination of hostilities, offer a laboratory with un- 
*qualed opportunities for the study of psychological disturbances 
and for the development of techniques for their detection. It is a 
Matter of practical rather than academic interest which should 
Prompt the military to investigate these problems on a large and 
tensive scale. Barring the eventuality of “thirty minute wars,” one 
of the prime personnel problems for a military organization to solve 
Will still be the adequate evaluation of the adjustment of both its 
Officer and enlisted personnel. . 

. The earliest organized effort in the Navy to secure a test to aid 
n the psychiatric screening of personnel came with the establish- 
ment of a National Defense Research Committee project. It was not 
Until June 1943 that a project report was published presenting 
details of the test developed under this project, a questionnaire en- 
titled the Personal Inventory. Subsequent research on this instru- 
ment produced a variety of significant changes, including a reduction 
11 the number of items from 145 to 20. For all practical purposes an 
C"ective and usable instrument with adequate validity data was not 
available for general use by the Bureau of Naval Personnel until 
February 1944. This statement, of course, does not take into account 
9cally initiated test development or validation projects designed to 
assist in the screening of psychiatric cases. . 

he role played by the Test and Research Section of the Bureau 
Naval Personnel came into being much later. Although the psy- 
Chologists assigned to this Section had been actively interested in the 
Progress of the work of the National Defense Research Committee 
Project and had been consulted in this connection on numerous 
Occasions. they did not begin direct participation in research on 
Psychiatric screening instruments until September 1944. 

. Activation of the research program within the Bureau came 
ау by way of a request from the Enlisted Classification Section 
и a test which could be used in screening WAVES applying pe 
i: TSeas duty, This request was followed almost immediately by 

Quests for further research on screening instruments 1n connection 
ie assignment of personnel to submarine and amphibious training. 
«ith the development of new tests and the revision of established 
vet eDtories, further data were required with respect to the emen 

tuit population, Projects were then set up to cover this broa 
Population in the training centers. The problem of psychiatric 


of 
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screening of reserve midshipmen was raised by the Officer оле 
Unit and a brief study of this question completed. Specific inv “и 
tion of test procedures for the screening of overseas усева 2x med 
ing signs of combat or operational fatigue was begun after a B 
for such an instrument was indicated by correspondence from *: 
commanding officer of a West Coast receiving ship, and from th 
Chief of the Bureau of Medicine and Surgery. . 
Personnel from the Test and Research Section were assigned ча 
the various projects as the pressure of work increased. оце“ 
development of the various research projects depended largely b- 
the receipt of specific requests in connection with particular уз | 
lems arising in other sections of the Bureau, or at various cmd 
centers or receiving ships, no overall research program was -— 
oped. This will account, in part at least, for a certain discontinu Y 
in the research undertaken and for the neglect of certain pore 
and problems which are undoubtedly significant for the gener? 
issues investigated. фе 
The instruments described in this section do not represent all й 
psychiatric screening instruments developed either within the и 
ог by such contractual agencies as the National Defense gee 
Committee. Only those tests used in connection with research p i 
ects undertaken by the Test and Research Section of the ce 
of Naval Personnel are described. While research data will De P s 
sented on only four of the instruments described below, descriptio 


of the others are included in order to indicate the different type 
of instruments developed and studied. 
ENLISTED PERSONAL INVENTORY, Form 2. This inventory gon 
two parts, Part 1 being a condensed form of the 145-item agg i 
Personal Inventory, Form 1, developed by the National Defe 


5 а rne 
Research Committee. Part 2 is the same as Form N of the Co? 
Selectee Index. 


More specifically, Part 
cast in forced-choice form 


ains 


E are 
A : hich 2 
l contains 20 items, most of whicl 


at, such as, 
I wish I weren't bothered I wish I could have 
. by bad dreams. — more excitement. 
B . E 1 C p we 
The term forced-choice is applied because the alternative state™ 
which are presented on о 1 


y pposite sides of the answer sheet, ete 
lie on any psychologi 


vably be inapplicable to his own experience: pre 

ustrative item above, it is entirely pos res 
dreams and has ај the excitement he MU 
to have. Some of the items of this test are in paired-choice 7? 
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than forced-choice form and do present statements which represent 
а continuum in the sense that they deal with different intensities of 
the same psychological symptom. For example, 


When excited I feel When excited I feel 
weak. stronger. 


Still other items are cast in yes-no form, which, in reality, is only a 
Special form of the paired-choice item. 

Part 2 (Cornell Selectee Index) consists of 32 items, all in yeso 
ormat, Since Parts 1 and 2 were developed independently, there is 
Some degree of overlap in the content of the items but this is not 
excessive. It was originally intended to score only 16 of the 32 items 
included in Part 2. These had been designated by the authors of the 
Instrument as stop items. The function of the stop item, as originally 

€scribed, was to make each single scored item crucial for screening. 
It any single one of the symptoms described was affirmatively re- 
Ported by the subject, he was to be eliminated or referred for inter- 
View, depending on how the test was to be used. Quite naturally, 
these items tend to deal with symptomatology of great severity and 
Significance from the diagnostic point of view. It is difficult to pick 
а representative item but the following will serve to indicate at least 
the typical form. 


Have you ever had a fit or a convulsion? Yes No 


The entire test is printed on an IBM answer sheet and can be scored 
Y either machine or manual means using a scoring stencil. . 
OFFICER PERSONAL InvenTORY, Form 1. This 164-item question- 
naire was developed by the National Defense Research Committee 
p.d contains material similar to that found in Part 1 of the Enlisted 
€rsonal Inventory, Form 2. In general the forced-choice item for- 
a Prevails. It is highly probable that future research will indicate 
€ Wisdom of reducing the length of this test to something com- 
ань to that in the test used with enlisted personnel. * T been 
dnd finding of most investigators that appa p^ y the I 
le ts can be obtained with relatively few items anc that extreme, 
"8th in such an inventory adds little to its validity. , 
tem analysis revealed that 50 items discriminated between mal- 
Usted and normal groups, and a scoring key has been developed 
sepas these items, The test is presented in a printed booklet ny 
aie IBM answer sheets for machine or hand scoring are avail- 
St; Personar Inventory, Form X-1(W). This test, which is sub- 
watially the same as the Officer Personal Inventory, Form 1, was 
Prepared for use with enlisted waves. Only those questions in the 


adj 
usi 


132 Selection and Classification 


original test which were specifically inapplicable to a female popula- 
tion were altered. Whenever possible, reasonably comparable ques- 
i ‹ possibles. y P 

tions were substituted for those requiring change. When the content 
was altogether inapplicable to a female group, a substitute question 
was chosen from the Enlisted Personal Inventory. 

The officer rather than the enlisted form of the Personal Inventory 
was adopted for waves use because the former is written in more 
sophisticated language. Since the educational level of the enlisted 
WAVES group 15 somewhat higher than that of male recruits it was 
believed that an adaptation of the officer form would prove more 
satisfactory. 

. BILLET QUALIFICATIONS BLANK, FORM X-2(M). This experimental 
inventory was developed for use with enlisted men in the general 
recruit population as well as for those being assigned to submarine 
and amphibious duty. To understand its basic format and content it 
15 necessary to appreciate that malingering in the sense of the ехав“ 
geration of symptoms 15 a reasonably rare phenomenon in the mili- 
tary services. When it does occur, psychiatric scrutiny seems indicate 
at all events and no loss is incurred by referral of the subject to om 
psychiatric unit. On the other hand, a careless attitude toward the 
test or a positive effort to produce an exaggerated picture of satis 
factory adjustment are much more common. It is in relationship (0 
such attitudes that the value of the previously discussed forced-chol" 
ape item must be assessed. In the first place, it permits alternatio" 
of answers so that the choice indicating good adjustment may appe?! 
on the left or right side of the page. This tion 
и prevents a casual marking “down the line" which is reasona es 
ci cim in the yesno format. In addition, since the alterna 
Iscontinuous in the sense of a cohesive or related psychologie 
сен. He person tested may actually have some difficulty А 
osing the indicati ; 1 
i. dud : answer least indicative of maladjustment. This а 
^ ани E : such an item as one which requires the indiv! = 
ew с 
нь dimi et SE he has suffered more from head colds or ™ 3 

m dizziness. Without regard to th i ility 50 
an ilem reg о the resistance or hostility a 

may engender in the subject, i i difficult 

"— te Ject, 1t plainly makes 
E Е ative indifferent test attitude. 

ith a view i š A 
accurate repou ~ Securing more careful introspection an at 
porting, and also to permit 5 yhate¥ 
exaggeration of А Р some correction for v in 
ot good adjustment did ex; were 
corporated in the Bill | 41d exist, three features 
illet Qualifications Blank. 


1. Many of the і ory 
items were i : the 
that most personnel in the о та billet context on the jet] 


with respect to thei 5 УУ, especially recruits, have some 277 - ct 


compels more atten 


d more 
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15 asked whether he thinks he is qualified or disqualified for a billet in 
which freedom from dizziness in high places is essential. In this way the 
anxiety associated with impending billet assignment is used as a pressure 
to produce more accurate and careful reporting. Both in the directions 
for administration and in other incidental features connected with the 
framing of the questions, the notion of the significance of the test for 
assignment purposes is kept constantly before the subject. 

2. А “self-idealization” scale has been included for the purpose of 
assessing the degree to which the individual attempts to exaggerate good 
adjustment. This scale is typical of the “lie” scale which may be found 
other psychological tests of personal adjustment. In this test, how- 
ever, the items are cast in the billet context. For example, a typical item 
calls on the subject to qualify or disqualify himself for a billet requiring 
an individual who never experienced either fear or anxiety. It was hy- 
Pothesized that a score on such a scale might act successfully as a sup- 
pressor variable when combined with other scores derived from the part 
А measuring maladjustment directly. If бе вани acted. бе 

; : х Я 
ment, itin m ea у зена и = eee the “self idealiza- 
tion” pposed he would receive a hig c У 

Scale which would operate in a measure to correct the distorte 
OW Score on the scale measuring maladjustment. There are many com- 
Plex, theoretical problems involved in the concept of a suppressor vari- 
d € to correct scores on personality tests. These cannot be discussed in 
Stail here, but the general possibility of raising the multiple correlation 
Ctween a battery of tests or parts of a test and a criterion by including 
est Or subtest with zero correlation with the criterion has received 
Previous attention in the psychological literature. | Е та 
mobi third feature of the test involves inclusion of items саси a 

in th 65 toward specific experiences both prior to and since enlistme 

з € Navy. It has been recognized that a purely symptom нараа р 
seri Measurement of adjustment, leaning heavily on the admission ofa 

SS. Of PSychosomatic disabilities, leaves much to be desired. On the 

“ory that the personal beliefs and social attitudes of the neurotic and 
оці differ markedly from those of the better adjusted individual, 
is 8 Of multiple choice items was included in the test. The following 


an j 5 : 
Sane of this type of item: . 
man shows that he's nervous about going to sea 


a 


(8) he probably feels like а lot of other fellows 
(b) he Ought to be kicked out of the Navy 
(©) he ought to be given a shore billet 


A The test contains 100 items and provision has been made for a 

Parate answer sheet which may be scored by hand or machine. 
e fu yee ey и : 
test is divided into three parts as follows: 


; Hors i ich Independent of the 
Criteri ^ Paul "The Role of Prediction Variables which are Independen 

ee "in Horst, Paul (Editor), The Prediction of Personal Adjustment, PP- T 

8, Supplementary Study Е, Social Science Research Council, New York, " 
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Part 1. Fifty items in which the individual is to qualify or disqualify 
himself for a billet in terms of the described characteristics. Ten of these 
items compose the "selfidealization" scale to which previous reference 
has been made. 

Part 2. Twenty-five items in which psychological and somatic symptoms 
are listed and the subject is required to indicate the frequency with which 
he experiences such symptoms. The answer sheet allows for the follow- 
ing responses: "Never," "At times," and "Often." Repeated instructions 
presented in this part indicate the importance of the answers for billet 
assignment. 


Part 3. Twenty-five items dealing with attitudes toward specific ex- 
periences both prior to and since enlistment in the Navy. 


BILLET QUALIFICATIONS BLANK, Form X-2(W). There are no sub- 
stantial differences between this form, developed for use with en- 
listed waves applying for overseas duty, and Form X-2(M) described 
in the preceding section. The differences that do exist relate solely (0 
those items which can have specific application only to one sex. 

EXPERIENCE COMPARISON INDEX, Form Х-1. This 63-item test con- 
tains many of the customary questions dealing with psychological 
and somatic symptoms. A somewhat greater emphasis than usual is 
placed on those symptoms which, for general clinical reports, have 
been presented as associated with combat fatigue. This emphasis 
is due to the fact that the test was prepared in response to a specific 
request for a screening instrument which would be effective with 
men returning from overseas duty. 

The principal feature which differentiates this test from the other 
inventories is found in the method of item presentation. It was sup- 
posed that men would more readily admit to neurotic symptoms if 
the question or item was so worded as to imply that such a condition 
was common to a group rather than individual and unique. There 
fore men were not asked directly whether they suffered from some 
particular ps re such as being sensitive to noises. Instead they 
were given preliminary instructions to the rious group’ 
of men had reported many different ex ES ee pies s zi 
that the purpose of the questionnair чет p ier 

Ire Was to permit the subject t9 


compare his own experiences and feelings with those of other mer: 
A typical item would then read: 


Group 6 men are very sensitive to noises. Yes No 


The subject would answer "yes" 
were like those of the group des 
had been different. 
PERSONAL CHECK List, 
all the items are cast in 


if his own feelings or experience? 
cribed, and “no” if his experience 


Form X-4. This is а 57-item test in which 
paired-choice format. Like the Experience 
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cele ag this test was developed specifically for the pur- 
sco ae = савана returning from overseas and therefore 
Tait die wei, Rae и оп those symptoms customarily associated 
паши tee difta à esignated combat fatigue." Three separate seg- 
сајта ~ 1 преписао, in the test. The first 27 items have been 
aed ndn a nes unit since they were subjected to fairly 
неа ation y extensive research with a large population of 
g veterans. Typical of this group 1s: 
I'm restless and wakeful I usually sleep pretty 
at night. мей. 


А хва m PG 
со . Е ЖЕТЕР? 
ilis Ted unit is represented by 15 items similar in every way to 
n 27 so far as format and reference to psychosomatic symptoms 
ton a qa These had not been subjected to equally rigid valida- 
and therefore receiv Y i г 
ed separate treatment 1n 
research, parate n the reported 
A thir 9 ; : " = 
т unit consists of 15 experimental items somewhat similar 
ne elie to the self-idealization scale described in connection with 
altered et Qualifications Blank. The form of the item has been 
to conform to the paired-choice setting of the other items 


in thi $ P mt 
1s test. Typical of this group 15 the following 1tem: 


A 
I've been troubled once in 
88 with thoughts about Sex ideas have never 

" уза once bothered me. 

ian durs Penan Recorp, FORM X-1. This 30-item test depends 

Qualification y on a theoretical idea first. presented in the Billet 
sigle on Blank but places the items in a paired choice form. 

example will indicate the general structure of the items. 


Iw 
Ould rather have a billet— 
——— (a) involving some danger ап 
——— (b) involving quiet routine an 


onse the Billet Qualifications Blank in с 
ари that introduction ofa paired-choice form would improve 
eterna eri Aside from the billet context of items, the other 

es of the earlier blank were not carried over Into this later test. 


xg ia 
Evious Duty CHECK List, Form X-1. This inventory would be 


ette 5 » 
T Characterized as a test of attitudes toward the Navy than a 
ted on the hypothesis 


Measu 
re of neurotic tendency. It was construc 
d positively with 


that А 
hostile attitudes or griping might be associate 
he specific military situation but 


d excitement. 
d some monotony. 


this form proceeded on 


_ Working parties were selected fairly. Yes No 
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Section 2 consists of five questions dealing with specific expe- 
riences such as, “Have you been injured?” No score is obtained m 
this part, the responses being intended for interview purposes ses 

SociaL Јорсмемтѕ Trsr, Form Х-1. This test has some of ли 
elements of a projective technique and bears a resemblance to € 
procedures which characterize the multiple-choice Rorschach, al- 
though the differences are far more significant than the resemblance. 
To understand the technique, it is necesary to examine first the 
directions for administration. These indicate to the subjects that 
success in the Navy depends to a great extent upon the ability to 
size up people correctly, to read their characters, moods, and ways of 
acting. Along with such instructions, the subject is given a sheet on 
which are reproduced twenty portraits of Navy personnel, exhibiung 
various facial expressions. On a separate sheet is presented a series 
of four statements for each picture supposedly indicative of four 
possible moods or thoughts which might be associated with each 
picture. The subject is required to select the statement which he 
thinks best characterizes the expression on each of the portraits. The 
assumption is that the subject will tend to project his own moods 
and ideas into the situation and thus mark those statements which 
best represent himself. . 

In the construction of the items, two of the four statements given 
for each picture were supposedly in the direction of maladjustment. 
The remaining two were assumed to be within the normal or ad- 
justed range. An example of the types of statement offered in con- 
nection with the photographs will be helpful. 

— — Wish I didn't have a stoma 
The best part of this dut 
—— Гога, but I'm tired. 


— A guy's personal feelings are not very important in a fight this big. 


ch full of butterflies. 
y is the “bull sessions” with the fellows- 


Procedures in Constructing the Tests 


In view of the frequent use of the phrase 


“u 1 ] 
1 measure of persona 
adjustment," 


djustment is a clearly 
of diverse, even mu 
ecessary to settle OP 
fore undertaking the 
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the fact that the precise nature of electricity is still not completely 
understood. 

Recognition of this point is important for an understanding of 
the progress and failings of research in the testing of personal adjust- 
ment. If all the elements, relationships, etiology, and dynamics 
entering into the concept of adjustment or maladjustment were 
known and understood, it would have been possible to concentrate 
attention on the construction of tests specifically pointed at the 
uncovering of known and essential elements. Actually such precise 
knowledge does not exist. Even more, the situation possessed an 
additional complication. It was not general adjustment or maladjust- 
ment which was to be predicted but specific personal adaptability 
to military service in wartime. Though this is but a special case 
M connection with the total adjustment-maladjustment problem, 
It should be remembered that adaptability to civilian modes of 
existence is likewise a special case. It could not be assumed that the 
Vastly more documented, though still inadequate, knowledge con- 
cerning personality deviations in civilian life would apply directly 
to the military situation. 
| If maladjustment cannot be sharply defined in terms of what it 
5, it can at least be described operationally, in terms of what it 
does, or in terms of the observable behavior patterns which may 
be reasonably said to stem from inner conflict and disturbance. Even 
Within the specific confines of the military situation, it is feasible 
10 express with some certainty the types of behavior which would 

© undesirable, if not intolerable. : | 

his suggests that research might find its most effective point of 
departure in the detailed analysis of successful and failing groups 
Within the military population to be predicted. From such analysis 
Might come sienificant data concerning the background factors, atti- 
tudes, and personal or physical characteristics which would serve as 
Predictive items in any experimental test. This procedure necessarily 
Involves long-range planning and long-term research. It implies 
Postponement of test development until experience with available 
Military populations has permitted a clear differentiation of ad- 
Justed аһа maladjusted groups followed by a careful study of the 
9PServable and measurable characteristics of these groups. 

Early in 1942 sucha program might have been feasible and sound. 
П 1944, when the Test and Research Section began из preliminary 
work on psychiatric screening tests, it did not seem practical to 
embark on the elaborate case history studies which were indicated 
as а significant preliminary to test construction. In lieu of this, the 

€velopment of experimental test items proceeded immediately along 
those lines which were indicated by immediately available evidence. 
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For example, some of the psychiatric literature on psychological 
disabilities in the military service was scanned for clues on predictive 
items. Similarly, the general psychiatric literature, without regard 
to its military content, served as a guide for item construction. Avail- 
able inventories in the field of personality measurement, both in 
military and civilian use, were scanned for pertinent suggestions. 
In short, existent materials were adapted to the test hunches of the 
personnel assigned to the various projects, and a series of ехрегі- 
mental forms were developed for validation. . 

While such a short cut procedure may have justification in a situa- 
tion of wartime urgency, it cannot be supported in future rescarch. 
The careful and logical prescription for an effective screening device 
calls for preliminary controlled studies of the characteristics of the 
military populations to be predicted. Instruments already developed 
have established their value in a very practical way. It is probable, 
however, that further advances in the measurement of adjustment 
can only come if the researcher is willing to retrace his steps and 
analyze the fundamental assumptions on which diagnostic and pre 
dictive items and procedures have been selected. 


Research Procedures 


Tue CRITERION. A psychiatric screening test is designed to predict 
whether an individual is sufficiently well adjusted to accommodate 
himself to military life without significant disturbance in regard to 
work to be performed or in social relationships. Psychiatric inter- 
viewing 1s essentially designed to perform the same task. Test pro 
cedures are used primarily to save time for psychiatrists by selecting 
that portion of the population most in need of special interviewing. 

It follows that a comparison of test results with psychiatric diag 
noses 15 merely a comparison of one prediction with another рге 
diction. To speak of test validity on the basis of the outcome of such 
a comparison is to assume, a priori, the validity of the psychiatrists 
judgments. Actually agreement or lack of agreement merely serves 
as an index to indicate the extent to which one procedure may serve 
to supplement or replace another procedure. Any more profound 
claims for a test which agrees well with a psychiatric prediction ct 


Patan eun Ohly be supported on the basis of clear evidence that the 
psychiatric prediction is valid in itself. 


It may well be argued that the tests, which were designed pt 
marily as an adjunct to th 


1 adj € psychiatric screening process, require 2° 
enl oe than a measure of agreement with psychiatric 

qo s his is true insofar as the tests are designated as measures 
ot psychiatric prediction and insofar as no claim is necessarily made 
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for them as measures of personal adjustment. It is to be hoped that 
future research will consider the psychiatric criterion as a prelimi- 
пагу measure of validity and take the logical step of determining 
actual validity by follow-up studies of the men for whom predictions 
are made. 

All of the research pertaining to the evaluation of the experi- 
mental instruments to be reported in this chapter has availed itself 
of the psychiatric criterion. While provision was generally made for 
further validation by case follow-ups within a period of time fol- 
lowing test administration, the termination of hostilities and conse- 
quent demobilization has made such procedures impracticable. 

It is also recognized that the mere statement that psychiatric diag- 
nosis or rating has been made to operate as the index of test effi- 
ciency is inadequate. Whose psychiatric diagnosis? Whose rating? 
Given under what conditions? These are extremely pertinent ques- 
tons. Psychiatrists will admit that there are significant variations 
In training and skill within the profession. Military necessity fre- 
quently compelled the use of unspecialized medical practitioners as 
neuropsychiatrists after very brief training courses. In a field in 
Which prediction is often difficult under the most favorable circum- 
Stances, it would be manifestly unwise to accept as an accurate crl- 
terion anything less than the most skilled and experienced judg- 
ments, 

To assure the soundest available criterion, research was conducted 
Wherever possible at those stations in the Navy which were recom- 
mended by the Neuropsychiatric Branch of the Bureau of Medicine 
and Surgery. Where psychiatric examiners were not available, ar- 
rangements were made for the assignment of a psychiatrist on tempo- 
rary additional duty. In other instances, where availability of a 
Particular population rather than of a criterion measure dictated 
Choice of a research station, and where special assignment of psy- 
chiatric personnel could not be made, substitute measures were 
taken. These included the development of external criteria through 
ratings supplied by classification officers, or the development of in- 
ternal criteria in which a rational scoring key was first employed 
to Segregate high scoring and low scoring groups. The significance of 
the differences between the high and low groups either in total test 
Scores or for individual items was then determined. In reality this 
Procedure made possible only an analysis for internal consistency 
and the validity of the items and of the test had ultimately to be 
determined by some adequate external criterion. In general, the 
Substitute measures employed proved unsatisfactory. . 

One major difficulty in the interpretation of any particular study 
Ог in the comparison of the results from several studies relates to 
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what may be termed the stringency of the criterion employed. By 
stringency is meant the degree of maladjustment which is held neces- 
sary for inclusion of a subject in the deviated group. If the psychi- 
atric criterion of maladjustment is set so that only the extreme 
deviates are included, predictive test data will almost invariably turn 
up with higher validities than if the criterion of maladjustment is 
less stringent and includes the moderately maladjusted. Since strin- 
gency in this sense can only be partly defined in advance and will 
depend as much on the attitudes and training of the psychiatrist as 
on the rating plan used, interpretation of every study must proceed 
with some reservations not only about the quality of the criterion 
but also about the level of prediction required. 

RzsEARCH Desicn. While considerable variation in detail will be 
found in the studies which follow, the general design follows a fairly 
uniform pattern. In the main, tests were administered to random 
samples of men at a given station, to men applying for some specific 
assignment, or to men returning from overseas duty. These men had 
been interviewed ог were later interviewed by a psychiatrist or а 
clinical psychologist with extensive experience in screening naval 
personnel. In some instances all men were given specific ratings оп 
an accepted rating scale. In other instances, the regular routine ol 
psychiatric screening was permitted to operate without special atten- 
tion to those subjects tested. The adjusted and maladjusted groups 
were then determined by a later check of the records of the Psy- 
chiatric Unit to ascertain the individuals discharged or otherwise 
subjected to psychiatric disposition. Test prediction and psychiatric 
prediction were then correlated in various ways. 

The pitfalls inherent in research in this area are more numerous 
and treacherous than in most psychological research. Three prob- 
lems in particular, though not necessarily the most significant, de- 
serve special mention in view of the fact that they are so generally 
recognized and just as generally undervalued. 

Nothing is so apt to produce delusions of grandeur in the con 
structor of personality inventories than the use of what might be 
termed the "ex post facto" psychiatric criterion. This involves à 
technique by which a hospitalized population is contrasted with 
successful military personnel in a training center. The difficulty with 
this procedure is that patients in a neuropsychiatric ward have gen- 
erally become so sensitized to clinical symptomatology that they по 
longer react in the way in which they would have reacted to the 
same instrument prior to hospitalization. Furthermore, the hospital 
wards generally contain a selected sample from the extreme of the 
deviated cases. This means an extremely stringent criterion group in 
the sense that the term has previously been employed. It is no 1€ 
markable thing, then that test score differentiation from a young 
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enthusiastic, and healthy recruit group can ђе obtained with con- 
siderable ease. As a single instance, one of the tests developed in the 

Bureau was administered to a neuropsychiatric ward population in 
a naval hospital. This group was found so far different from a ran- 
dom sample of qualified recruits drawn from a training center that 
8776 of the hospital group scored above an established critical score 
point whereas only 4% of the qualified recruit group was found 
Within the same range of scores. Needless to say, the test was not 
found so efficient under more exacting circumstances in which ad- 
Justed and maladjusted individuals were intermingled in the same 
group and before the deviates had been identified psychiatrically. 

Comparable exaggeration of the efficiency of a test may sometimes 
be noted when, in the course of the research, test papers are made 
available to the psychiatrist for interview purposes. However much 
Psychiatrists may assert that their opinions are uninfluenced by 
Scores, there always remains an open question as to whether their 
criterion judgments have really remained uncontaminated despite 
knowledge of the variable whose validity is being assessed. 

A third research procedure which too easily leads to unjustifiable 
optimism involves the use of an experimental population for the 
development of a scoring key and the immediate application of the 
key to the same population. Explanatory and apologetic footnotes 
May serve as a balm to the experimenter's conscience but they rarely 
serve as a guide to the kind of attenuation to be anticipated when 
the test and key are applied to a new population. 

_ Ideally, tests to be validated would be administered to a popula- 
tion of inductees, the total group would then be admitted to military 
Service and follow-up studies at various intervals would be made to 
determine success or failure of adaptation to the demands of military 
life. Every man tested would be given a very careful, extensive, and 
Independent psychiatric examination by the most competent medical 
Personnel available. In practice, however, theoretical perfection was 
Necessarily sacrificed to operational schedules and personnel short- 
ages. Typical psychiatric examinations were brief and generally de- 
Void of careful preliminary elaboration of case histories. Fortunately, 
Considerable work has been done in the Navy in condensing the 
Psychiatric interview and yet preserving its essential values. It is 
felt that, in most instances, the criteria available possessed a high 
degree of significance as measures of test validity. 


Findings 
It is possible to present only major findings of a few sample studies 
Conducted with some of the instruments previously described.’ These 


5 Low scores in these instruments imply good adjustment and high scores imply poor 
adjustment. 
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will serve to illustrate the general research design employed as well 
as typical results obtained. Table 1-1x summarizes the procedures 
followed in connection with three different projects aimed at asses- 
sing and comparing the validity of four different screening tests. 


Research on Enlisted Personal Inventory, Form 2 


‘This instrument was included in both Study I and Study П sum- 
marized in Table 1. Direct comparison of the findings in these two 
studies is difficult since different keys were employed in each research 
and the criteria are comparable only in a general sense. 

Stupy I. In this study 561 men were tested and then given inde- 
pendent examinations and ratings by both a clinical psychologist 
and a psychiatrist. Since the data were accumulated over a period of 
time, the first 340 cases received were analyzed independently as 


Sample 1, and the remaining 221 were employed as a second or 
check sample—Sample 2. 


Each subject was rated by both a psychi 


atrist and a psychologist 
on a scale defined as follows: 


Group I. The group which can function with reasonable 


effectiveness in military service even though minor, 
non-disabling psychological symptoms may be pres 
ent (treated as normal men in this study). 

The group with marked psychological symptoms of 
such a character that there exists a doubt about their 
successful adjustment to the military service though 
no action, administrative or otherwise, is presently 
indicated (treated as maladjusted men in this study). 
The relatively small group of men whose psycho- 
logical adjustment is so poor that they are con- 
sidered as temporarily disabled for effective military 
service and whose condition would warrant theif 
being considered for such administrative disposition 
as: shore duty; extended leave; special assignments 
rest camp; etc. 

Those few cases who are so seriously disabled in the 
psychological sense as to warrant hospitalization or 
immediate survey (Both A and B were treated in the 
maladjusted group in this study). 

In scoring the Enli 
considered 


Group II. 


Group III-A. 


Group III-B. 


ens in planning and conducting 
ng and conducting Study mm 
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developed by previous research. Part 2 was scored on all 32 items 
without reference to the special significance of stop items. This crude 
procedure was followed because of some earlier indications given 
by the psychologists at Receiving Station A that such scoring had 
proved effective. Since an item analysis was not attempted, no in- 
formation is available on the possibility of improving prediction by 
means of a key based on use of the more differentiating items. 

As has been previously noted, two separate criteria were employed, 
namely, the ratings given by psychiatrists and the ratings given by 
clinical psychologists. This makes possible separate analyses for each 
type of criterion or for various combinations of criterion judgments. 
Such detailed data are available in the original research report but 
are too voluminous to present in this summary. For illustrative pur- 
poses, that portion of the data is presented which employs, as the 
criterion for maladjustment, the decision of either the psychiatrist oT 
the psychologist that the subject belongs in rating groups II, III-A, 
or III-B. All other subjects are then automatically considered as 
belonging in group I, they being in effect the men considered by 
all examiners as normal. 

Figure 1-1x presents a cumulative percentage distribution of scores 
on Part 1 for the normal and maladjusted groups in Sample 1, and 
in addition, the test score distribution for the total population in the 
sample. It should be noted that this type of graphic presentation 
permits a simple and rapid determination of the kind of prediction 
to be anticipated when any given percentage of the total group is 
referred for examination. If it is decided to refer 20% of the men 
for psychiatric investigation, then it is possible to read across from 
the 20% point on the vertical axis to the line representing the total 
population. On the base line will then be seen the test score which 
should be used to secure referral of approximately the desired per- 
centage. At the same time it is possible to determine what the T€ 
search has indicated in terms of the percentage of the normals who 
will be included in the referred group as well as the percentage of 
the maladjusted men who will be included. In view of the fact that 
these tests are not designed for use with specific cutting scores but 
are for use in referral of varying percentages of men depending 0n 
numbers that can be conveniently handled by psychiatrists at a give? 
time, the practicality of this type of graphic presentation can readily 
be seen. 

One special distribution curve contained in Figure 1-х requires 


5In general, item selection in these resear 
effectiveness with which the it 


adjusted vs. normal). Inter-ite 
consistency have been conside: 


i ches was primarily predicated on the 
em differentiated between criterion groups (e.g. mal- 
m correlation, item difficulty, and selection for internal 
red in connection with some item analyses. 
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individual explanation. It will be noted that two separate distribu- 
tion lines have been drawn for maladjusted groups. One of these 
(N=98) is complementary to the curve for the normal population 
and together with this latter group produces the curve for the total 
population. A second distribution curve (N=38) represents only 
a portion of the cases included in the larger maladjusted group and 
was selected out of the larger group in order to illustrate a point 
previously made in the discussion of the criterion. Whereas a subject 
might have been included in the larger maladjusted group because 
of the diagnosis of either the psychiatrist or the psychologist, only 
those men who were called maladjusted by both examiners were 
included in the smaller group. Presumably this latter group repre- 
sents the most deviated population, clearly identifiable as such on 
two separate examinations. It is interesting to observe, therefore, 
that the cumulative percentage curve for this small group is mark- 
edly higher than for any other group. Expressed another way, it 
means that for this group, in which the most stringent criterion of 
independent identification by two separate examiners is employed, 
test prediction is easiest. Repeated illustrations of this point, that 
the more stringent the criterion the easier the prediction, could be 
presented in all the remaining graphs; but it will suffice to say that 
in this regard Figure 1-1x offers a typical result. 

Figure 2-1x presents data on the same men (Sample 1) but this time 
for Part 2 of the Enlisted Personal Inventory. These data are directly 
comparable with those contained in Figure l.ix, since the same 
criterion is employed in both instances. To simplify the comparison 
of these data, Table 2-1x indicates the discriminative power of Parts 
1 and 2 of the Enlisted Personal Inventory at successive percentage 
levels of referral. Further comparisons of a similar nature for 
other referral points may be read directly from Figures lax and 2-1%: 

Simple inspection is sufficient to indicate that Parts 1 and 2 of the 
test have functioned with approximately equal effectiveness in pY€ 
dicting the deviated group and at approximately the same cost 17 
the inclusion of false positives (i.e. normals incorrectly referred 0? 


а: Fest score basis). Whatever differences do occur are too slight t? 
Invite positive interpretation. 


Results for Sample 2 are similar to t 
хедив separate presentation. 

Since Part 1 of the Personal Inventory contains items in forced- 
choice form whereas Part 2 items are cast in yes-no format, it maY 
appear that the form of the item does not influence the validity 9 
the items or that of the total test. Such an interpretation fails to take 
into account the possibility that Part 2 items may cover a more de- 
tailed and significant clinica] symptom picture than Part 1 and that 


hose in Sample 1 and do not 
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this more adequate coverage compensates for the possibly less effec- 
uve item format used in Part 2. Indeed, a reading of the two parts 
Suggests that the item format of Part 1 is intrinsically sounder, but 
that the symptom inquiry in Part ? is clinically more profound. As 
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[NE oa is no conclusive answer to the very important question as 
indi € most effective item structure. One independent investigation 
t directly related to the present research but conducted with other 
est Instruments, produced data tending to support the notion that 
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the paired-choice type of item is substantially superior to the yes-no 
type. Until items of similar content but different format are tested 
against the same criterion it will be impossible to arrive at a definite 
decision in the matter. The question is of sufficient importance, 
however, to warrant further intensive study. 

Srupy II. Use of the Enlisted Personal Inventory at Naval Train- 
ing Center B differed from the procedure at Receiving Station A in 
that no special psychiatric investigations were initiated as part of 
the research study. The regular screening process was permitted to 
operate at Naval Training Center B and the development of a cri- 
terion came as a result of a follow-up inquiry at the Psychiatric Unit 


TABLE 21x. Enlisted Personal Inventory, Parts 1 and 2: Percentage of 
normal and maladjusted men who would be referred for psychiatric 
examination at various percentage levels of total population studied. 
Receiving Station A, Sample 1. (Percentages obtained from Figures 1 and 2) 


= а 
Percentage of normal men Percentage of maladjusted 
who would be incorrectly men who would be cor- 

Percentage of total referred by Enlisted Per- rectly referred by Enlisted 

population to be sonal Inventory Personal Inventory 
referred on test — 
score basis Part 1 Part 2 Part 1 Part 2 
10% 38% 3% 271% 29% 
15 5 5 40 39 
20 7 7 51 51 
25 11 N 60 61 
30 14 15 69 67 
40 23 25 80 76 


Norz.—This table and similar ones which follow are interpreted thus: If 10 per cent 
of the total population is to be referred for psychiatric examination, Part 1 of gie 
Enlisted Personal Inventory will incorrectly refer 3 per cent of the normals and COT- 


rectly refer 27 per cent of the maladjusted. Comparabl 
" t 2 are 
and 29 respectively. i аи 


made soe months after the data had been collected. A tabulation 
was then made with respect to the men tested to determine which 
ones had been referred for investigation as potential disability case? 
and which of the men had actually been discharged on neuro- 
psychiatric grounds. | 


The following division was made of th i 4,303 
men who had been tested: ин 
Group Ia —1,996 normals (accepted for duty). Tests used in 

item analysis. 
Group Ib —1,996 normals 


accepted for duty). : dic- 
tion study. => or duty). Used in pre 
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Group Ila —58 referrals returned to duty. Tests used in item 
analysis. 

Group IIb —57 referrals returned to duty. Used in prediction 
study. 

Group IIIa—97 dischargees (neuropsychiatric). Tests used in 
item analysis. 

Group IIIb—99 dischargees (neuropsychiatric). Used in predic- 
tion study. 


"This division of the population permitted item analysis employing 
M and deviated populations and subsequent cross validation of 
16 scoring keys on groups not involved in the item analysis. 


TABLE Зах, Enlisted Personal Inventory, Form 2, Parts 1 and 2: Percent- 

age of normal and maladjusted men who would be referred for psychiatric 

“amination at various percentage levels of total population studied. 

Naval Training Center B, Groups Ib, IIb, IIIb. (Percentages obtained 
from Figures 3, 4, and 5) 


Percentage of maladjusted? 


Percentage of normal! men 
men who would be correctly 


who would be incorrectly 


torah ee of referred by Enlisted Personal referred by Enlisted Personal 
to be x dim ation Inventory Inventory 
red on 
test score basis Part 1 Part2 Parts1&2 Part 1 Part2 Parts1&2 
10% 7 1% 79%, 55% 57% 629; 
15 oe ox an m 
zm 16 17 16 72 71 75 
= 21 21 20 78 74 79 
30 26 26 26 79 78 81 
= 36 35 37 82 85 8 


1 
Stoup Ib: Well adjusted. 
oup IIIb: Discharged. 


di Figures 3-1х, 41x, and 5-1x present the cumulative percentage 
"Istributions for the Personal Inventory, Part 1, Part 2, and Parts 
а. 2 combined. Only those cases not used in the item analysis 
ren ee in these distributions. А " 
nn analysis had resulted in the development of a 17-item key 
ha 1, three of the original items having been found to have 
the k степе validity for retention. Nineteen items were retained in 
item су for Part 2. No effort had been made to eliminate overlapping 
S in the two parts since each was to be employed separately. 
he combination of scores was accomplished simply by adding the 


Scor 
Ta 9n the separate parts. : 
able 3-1x summarizes results at various possible percentage levels 
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of referral, enabling immediate comparison of the graphs at a few 
specific points. As previously indicated, further comparisons are pos- 
sible by direct reference to the graphs. 

The results obtained in Study II are in agreement with those ob- 
tained in Study I, at least to the extent of establishing that Parts 
l and 2 of the Enlisted Personal Inventory have approximately equal 
validity. Furthermore, it would appear that the combination of part 
Scores adds nothing to the predictive power of either part. This is 
in harmony with repeated findings that a relatively few items dealing 
with symptomatology operate just as effectively as a long and elabo- 
"ate collection of items. It seems probable that, with the symptom 
measurement approach, the use of more than 20 or 30 items adds 
nothing to validity of prediction. 

For the recruit population the intercorrelation of Parts 1 and 2 
Was „80. This supports the previous finding that these measures are 
interchangeable as they now stand. The relationship between scores 
Оп either part and scores on the General Classification Test (intelli- 
8ence) is low, with correlations ranging from —.02 to —.13.° It 
Should not be supposed from such correlations that intelligence 
55 а negligible factor in the psychiatric screening process. Actually 
the mean General Classification Test score of the discharge group is 
More than half a standard deviation below the mean for the total 
Population, Intelligence, then, must be considered а significant 
actor in the psychiatric screening process even though its correla- 
Чоп with scores on the personality inventories is fairly negligible. 


Research on Billet Qualifications Blank, Form X-2(M) 


Зтору II. At the same time that the men were given the Enlisted 
€rsona] Inventory at Naval Training Center B, they were also 
Administered the Billet Qualifications Blank. The population is 
Identical with that discussed in the immediately preceding section, 
and all research procedures presented there were duplicated exactly. 
. ^5 а result of item analysis, that segment of the Billet Qualifica- 
"ons Blank Which depended on the measurement of personal beliefs 
and social attitudes as a neurotic index was discarded. A single 39- 
item Predicting scale, hereafter called the N-Scale, was developed 
for the Measurement of maladjustment. The 10 items of the self- 
idealization scale, hereafter called L-Scale, were reduced to a scoring 
ФУ with 4 items. These few items were chosen in terms of the 


i ince high scores on the Personal Inventory are in the direction of maladjustment, 
ese correlation coefficients generally appear with the negative sign ebur dure 
€ coefficients must actually be interpreted to mean that there is a slight ten p 
9r individuals Who score as maladjusted on the inventory to score lower on the test о 


intelligence. 
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theoretical premise previously discussed, namely that a suppressor 
variable should have a low or zero correlation coefficient with the 
criterion and be substantially correlated with the prediction vari- 
able. To the extent that the L-Scale conformed to this standard, it 
might be expected to operate in the direction of eliminating from 
N-Scale measurement those factors which were irrelevant to the 
prediction of the criterion. " 
Figure 6-1x presents the cumulative percentage distribution of 
N-Scale scores for the men in Groups Ib, IIb, and IIIb at Naval 
Training Center B. Figure 7-1x presents cumulative percentage dis- 
tributions of scores for the same men when L- and N-Scale scores 
were combined. The significant question with respect to these data 


Taste 41x. Billet Qualifications Blank, Form X-2(M), Scale N and Scale 

N plus Scale L: Percentage of normal and maladjusted men who would 

be referred for psychiatric examination at various percentage levels of 

total population studied. Naval Training Center B, Groups Ib, IIb, IIb. 
(Percentages obtained from Figures 6 and 7) 


Percentage of normal! Percentage of maladjusted? 
men who would be incor- men who would be cor- 
Percentage of total rectly referred by Billet rectly referred by Billet 
population to be Qualifications Blank Qualifications Blank 
referred on test MÀ À—7À 
score basis ScaleN — Scales М +L ScaleN Scales N + L 

10% 1% 1% 49%, 54% 

15 12 11 64 64 

20 17 17 67 69 

25 21 21 71 72 

30 26 26 75 77 

40 36 36 81 84 


ne es a 


1Group Ib: Well adjusted. 
? Group IIIb: Discharged. 


is whether the 4-item self-idealization key has made any improv 
ment in prediction, whether in fact this modest suppression key has 
actually corrected the scores on the maladjustment scale in the prope" 
direction. 

Table 4-1x shows the results for Naval Training Center B for the 
N-Scale alone and for Scales N plus L. These data are so presente 
that they may be compared with the referrals made by the Enliste 
Personal Inventory as shown in Table 3-1x. 

There 15 a slight consistent improvement in prediction when the 
suppression key is used along with the key for the measurement 9 
maladjustment. The improvement is small and can only be take? 
as indicating that the technique of assessing an idealization tre” 
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in order to correct a score for maladjustment is worth further in- 


vestigation. 
The Billet Qualifications Blank as a whole differentiated the dis- 


charged population from the accepted population somewhat less 


Whether this is due to the fact that a billet assignment context for 
the questions has no important effect on test validity, or because 


sharply than the Personal Inventory, though the differences are too 
slight at any referral level to have much statistical significance. 
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the item contents of the two tests are of unequal clinical significance, 
or because the item formats differed in other respects than the billet 
context cannot be determined at this time. It seems improbable how- 
ever that any large improvement in prediction can be anticipated 
from linking the inventory with the billet problem. 

| Srupy III. Validation of the Billet Qualifications Blank at Re- 
"ilie анн г. proceeded ma somewhat different basis than at 
Tra g Center B. Whereas in the latter station the routine 
screening process provided the means for establishment of a crite- 
rion, special psychiatric and psychological examinations were insti- 
tuted at Receiving Station C in connection with the entire experi- 
mental population. These examinations were conducted before 
testing took place and the psychologists and psychiatrists who co- 
Operated in the project employed a pre-established rating scale for 
evaluating each subject. 

Ми specific definitions employed for rating the men were as 

ows: 


Group I — Fit for sea duty; shows no disabling features of a psycho- 
logical nature; despite sea or foreign shore duty, shows 
no obvious combat or operational fatigue symptoms; 
looks like А-1 material; should not break down under 

У stress (used in study as normal group). 

Group II Probably fit for sea duty; shows minor disabling features 
of a psychological nature; some combat fatigue, opera- 
tional fatigue, or nervous tension symptoms, but may be 
able to weather further sea or foreign shore duty (used 

Gror in study as doubtful group). -— 

1р HI Questionable material; shows disabling features of a 
psychological nature; tension or fatigue symptoms evi- 
dent; may or may not be useful aboard ship (poor ad- 

G justment group in study). . 

Toup IV Unfit for sea duty; marked disability and clearly un- 
suitable for further active service afloat at this time 


(poor adjustment group 1n study). 


Groups III and IV were combined in the study because: (1) there 
be ag only nine men allocated to Group IV and (2) the examiners 
vho had done the screening gave indications that men allocated to 
Group Ш were distinctly inferior in adjustment to the problematic 
Cases contained in Group II. It should be noted that whereas over 

men were tested and rated in this study, a lesser number will 

€ reported both in connection with the Billet Qualifications Blank 
and with the Experience Comparison Index (which was administered 
at the same time). This discrepancy is due to the fact that a small 
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segment of the population was eliminated from the prediction group 
after being used for item analysis purposes. | 
Figures 81x and 9-1x present the test score data for the Billet 
Qualifications Blank, N-Scale and Scales N plus L, on a sample of 
268 cases. These data from Receiving Station C are difficult to 
compare with those from Naval Training Center B. The criteria 
were different in terms of stringency, procedure, and personnel 
responsible for their development. The populations were very dif- 
ferent, Naval Training Center B involving only recruits entering 
basic training, Receiving Station C involving men who had had 
extensive tours of sea duty. Even the scoring keys were different, the 
N-Scale consisting of 40 items which overlapped the 39 items em- 


TABLE 5-1x. Billet Qualifications Blank, Form X-2(M), Scale N and Scale 

N plus Scale L: Percentage of normal and maladjusted men who would 

be referred for psychiatric examination at various percentage levels of 

total population studied. Receiving Station C. (Percentages obtained 
from Figures 8 and 9) 


Percentage of normal Percentage of maladjusted? 
men who would be incor- men who would be cor- 
Percentage of total rectly referred by Billet rectly referred by Billet 
population to be Qualifications Blank Qualifications Blank 
referred on test 
score basis ScaleN Scales N + L Scale N Scales N + 1 
1076 5% 2% 959, 289, 
15 3 3 35 38 
20 4 4 46 52 
25 6 6 53 60 
30 9 8 63 67 
40 13 13 75 78 


1Group I: Well adjusted. 
2 Groups III and IV: Poorly adjusted. 


ployed in Study II but differed in several substantial respects. А150, 
the L-Scale used in Study III employed all 10 items as contrasted 
with a restriction to 4 items used in Study II. 

Table 5-1x offers a few comparative statistics on prediction by Фе 
N-Scale and by the N-Scale corrected through additions of L-Scale 
scores. 

The interesting fact to be noted in the tabular and graphic data 
is that the suppression key has improved prediction noticeably- 
Though interpretation of this result must still be made cautiously: 
at least on the surface it would appear that the type of exaggeration 


1 For a second sample of 189 cases, treated in the same manner, similar results were 
obtained and hence are not presented here. 
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measured by the L-Scale is actually a factor in distorting answers on 
the N-Scale and thus detracting from the prediction of the criterion. 
Adding the two scores together seems to have the effect of subtracting 
from the N-Scale scores an element which is uncorrelated with the 
criterion and thereby purifying such scores. Before such a conclu- 
sion would be warranted in fact, however, much better verification 
than is presently available would be needed. 


Research on Experience Comparison Index, Form X-1 


Srupy III. This test was administered to the same population as 
that used in the study of the Billet Qualifications Blank above. This 
enables direct comparison of the two tests for a situation which 
employed the same population as well as the same criterion. Figure 
10-1x, which presents the data for the Experience Comparison Index, 
Includes a special distribution curve which must be considered 
Separately from the remaining distributions. This curve represents 
the cumulative percentage of cases found at successive score levels 
for a population of hospitalized neuropsychiatric patients. As in the 
earlier presentation of a similar problem in Figure lax, it will be 
noted that the more aberrant or deviated are the cases to be pre- 
dicted (criterion of greater stringency), the more successful is the 
Prediction, The hospitalized population obtains higher (therefore 
poorer) scores on these inventories than even a maladjusted group 
Within a combat veteran population. If the contrast had been be- 
tween the scores of hospitalized patients and a raw recruit popula- 
tion, the differences would have been even greater. 

This finding has particular importance because of the frequency 
With which the literature on research in personality test validation 
recommends or uncritically supports the use of experimental groups 
With known psychological differences. Such differences must ulti- 
mately be established in any research if the validity of prediction is 
to be estimated. The danger lies in overestimating results when 
using gr oups already differentiated by previous psychiatric diagnosis, 
“specially under conditions which have isolated only the most ex- 
treme deviates, . 

Table 6-1x permits ready comparison of the Billet Qualifications 
Blank and the Experience Comparison Index in Study III. | 

Prediction through use of the Billet Qualifications Blank is some- 


8 Differences in the sizes of populations reported for the Billet Qualifications Blank 
and the Ex arison Index are due to the fact that the analysis in con- 
i ction with the former instrument split the total group (remaining after eliminating 
М = item analysis group) in order to develop data on two separate samples. The analysis 
or the Experience Comparison Index employed а different number of cases for item 
‘nalysis and then considered all the remaining cases as а single population. 
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what sharper than with the Experience Comparison Index. The 


hen used in situa- 


he success of various instruments w 
tions which permit direct comparison are, however, far more signifi- 


ies in tl 


similarit 


cant than the differences which are noted. The general impression 


d that most of these inventories, regardless of item format 
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or even the specific neurotic symptomatology investigated, produce 


about the same sharpness of prediction. It is almost as if a kind of 
plateau in prediction had been reached through the symptom ques- 
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tionnaire approach. Sharply different methods will probably have 
to be experimented with before very significant advances are made 
beyond the present accomplishments. 


Research on Personal Check List, Form X-4 


Зтору I. Data were presented earlier in this report on the use of 
the Enlisted Personal Inventory in predicting maladjustment 
among overseas veterans being processed at Receiving Station A. 

Since the Enlisted Personal Inventory had been developed for use 
with recruits rather than with overseas veterans there was some ques- 
ton as to its validity with this latter group. 


TABLE 61x. Experience Comparison Index, Form X-1, and Billet Quali- 

fications Blank, X-2(M), Scale N plus Scale L: Percentage of normal and 

maladjusted men who would be referred for psychiatric examination at 

Various percentage levels of total population studied. Receiving Station С. 
(Percentages obtained from Figures 9 and 10) 


— 


Percentage of normal! men 
who would be incorrectly 
referred by 


Percentage of maladjusted? 
men who would be correctly 
referred by 


Percentage of total 


Population to be Experience Billet Qualifi- 


Billet Qualifi- 
Comparison cations Blank 


Experience 


referred on test Comparison cations Blank 
Score basis Index Scales N + L Index Scales N --L 
10% 1 2 26% 28% 
15 $^ "id 37 38 
20 5 4 44 52 
25 6 6 52 60 
30 8 8 60 67 
40 13 13 71 78 


2 Group I: Well adjusted. 
TOUps III and IV: Poorly adjusted. 


Preliminary experimentation at a West Coast receiving ship had 
resulted in the development of the Personal Check List, Form X-3. 
lhis 27-item instrument employed a number of items directly asso- 
Clated with the so-called “combat fatigue" syndrome as it is generally 
lelineated. The general exploratory work involved in test construc- 
tion had given some indication of the superiority of the new instru- 
ment over the Enlisted Personal Inventory when used with combat 
veterans, Study I was then set up as a more definite check on the 
Comparative validity of the two tests for use with personnel posses- 
Sing considerable operational or combat experience. 
Before administering the Personal Check List at Receiving Station 
A, several experimental additions to the blank were made, though 
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no changes were made in the original 27 items. First, 15 relatively 
untried items dealing with symptomatology not covered by the 
earlier form were added to determine if they would improve pre- 
diction. Second, 15 items in the nature of a self-idealization scale 
were added. These latter items differed from those in the Billet 
Qualifications Blank in content and also in format, the paired-choice 
structure having been adopted in keeping with the rest of the Per- 
sonal Check List. With these two additions, the X-3 form became 
known as Form X4. 

Figure 11-1x presents data on the first sample of Receiving Station 
A men tested by the Personal Check List, Form X-4. It will be noted 
that this represents analysis of the data for the same population as 
is treated in Figures 1х and 2-1x in which the Enlisted Personal 
Inventory distributions were presented. It should also be noted that 
Figure 11-1x covers results only for the 27-item key of the Personal 
Check List. This key included only the items originally contained 
in the earlier Form X-3 since it was soon apparent that the 15 addi- 
tional symptomatic items and also the 15 items dealing with self- 
idealization trends had failed to produce any increase in discrimina- 
tion for the test. 

In view of the important theoretical problem involved, it would 
be well to examine more closely the fact that the 15 self-idealization 
questions had no marked effect either in the direction of increasing 
or decreasing the predictive efficiency of the test. Data are not avail- 
able as to the correlation coefficients of individual items of the зе!- 
idealization scale with other items, with total test scores, or with the 
criterion. The analytic procedure used involved only the crude addi- 
tion of scores on all 15 items in the self-idealization scale to scores 
on the total test. It is felt that the full potentialities of a suppression 
key have not thereby been adequately evaluated. It may very well 
be that the type of correlations found for the Billet Qualifications 
Blank will not be found in connection with an item format em- 
ploying the forced-choice technique. But until more detailed analysis 
1s completed, no final conclusions should be drawn. 

Figure 12-rx also deals with the 27-item key of the Personal Check 
List but concerns itself with a second sample of 221 men at Receiving 
Station A? It will be noted that with the Personal Check List pre 
considerably sharper than for the first 
id with certainty which result more 


9 The second sample data Wt i ent ry 
ere not previousl pres г Inv! 
ве тезі у sented for the Personal 


50 nearly like the findings for the first group. 
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tribution of all scores in the later expe 


arge population tested 


at a West Coast receiving ship. This was not true for the first and 


somewhat larger sample. 
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In order to assess differences in validity as between the Personal 
Check List and the Enlisted Personal Inventory, and also to permit 
a comparison of results obtained with the Personal Check List on 
two separate samples of the Receiving Station A population, pre- 
dictions at various referral levels are shown in Table 7-1x. 

The comparative data on Sample 1 indicate that there is little to 
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choose between the Personal Check List and Part 1 of the Enlisted 
Personal Inventory. However, when the second sample is considered 
there can be observed a marked difference in predictive efficiency. 
The Personal Check List consistently picks up a higher percentage 
of maladjusted men, and though there seems to be some slight addi- 
tional cost in false positives, the overall results definitely favor the 
Personal Check List. It is impossible to say whether a repetition of 
the experiment with very large samples would continue to produce 
the same results, but the evidence to date favors the Personal Check 
List at least for those personnel with considerable sea duty. 


TABLE 7-1x. Personal Check List, Form X-4, and Enlisted Personal In- 
ventory Form 2, Part 1: Percentage of normal and maladjusted men who 
would be referred for psychiatric examination at various percentage levels 
of total population tested. Receiving Station A, Samples 1 and 2. (Per- 


centages obtained from Figures 2, 11, and 12) 
——— 


Percentage of maladjusted men 


Percentage of normal men who who would be correctly 


Percentage of would be incorrectly referred by referred by 

total popula- Enlisted Enlisted 

EOD to be re- Personal Personal Check List Personal Personal Check List 

erred on test Inventory ——— ——— —. - Inventory 
10% 3 3 2 27% W% 44% 
15 25 1“ У 40 39 55 
20 7 8 8 51 53 68 
25 n 10 12 60 63 74 
30 14 18 18 69 72 79 
40 28 25 27 76 77 90 

Other Studies 


It has been necessary to omit a very considerable body of data 
dealing with other populations and instruments. A number of 
Studies have been made using the inventories already reported and 
Other tests in connection with applicants for submarine duty, with 
amphibious personnel, with midshipmen, with wAVES, with prison 
Populations, etc. The implications of several findings drawn from 
these various studies deserve brief mention. 

It has been interesting to note that a rather well defined hierarchy 
Of means for any test can be found as different populations are tested. 
The lowest mean scores are generally found among submarine volun- 
teers. Raw recruits have a somewhat higher mean. Amphibious per- 
Sonnel will generally have average scores that are even higher, and 
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combat veterans almost invariably obtain average scores higher than 
any of the other groups. | — 

Such a state of affairs may be subject to several interpretations. 
It may be taken as evidence of validity in the sense that a test score 
hierarchy seems to fit general expectation concerning the adjasan 
of the populations in question. Submarine volunteers are high у 
selected and presumably well adjusted individuals. The raw recruit 
population is a relatively undifferentiated group. The amphibious 
personnel included a large number of "general detail men w ho 
were not qualified or not needed for school or special assignments. 
Men who had combat experience might be expected to show thc 
effects of such duty and exhibit symptoms of maladjustment to а 
fairly marked degree. 

On the other hand, the situation is just as amenable to interpreti- 
tion in terms of motivation. Men applying for submarine duty аге 
highly motivated. As a volunteer group, they are extremely eager to 
make a good impression and qualify for submarine training. Raw 
recruits, too, generally have reasonably high motivation since all thc 
indications are that men passing through the initial training stages 
are generally eager to do well in the service, though the motivation 
is hardly as high as in the case of the submarine group. There b 
reason to believe that the amphibious forces were somewhat less 
motivated (see Chapter XXI). Certainly the motivation of the com 
bat-experienced groups, at least so far as the tests were concerned. 
was less than for any of the other groups. Simple observation has con- 


firmed the fact that these men were indifferent to the tests and 


cynical concerning anything except the chance for immediate shore 
leave. 


hierarchy into 
actual adjustme 
in producing th 


effect of using a 
group will not neces 
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only 1 chance in 20 of being screened out. Perhaps this means that 
psychiatrists themselves adjust their thinking to the class of men 
with whom they deal. At training centers a certain symptom picture 
may be given considerable weight in bringing about the discharge 
of a man from naval service. The same symptom picture appearing 
in a man just returned from combat duty may be so commonplace 
and unimportant.as to merit no more than passing attention. Or it 
may mean that the psychiatrists screen on some other basis than the 
mere summation of a series of symptoms as is true of the test. It 
is interesting to note, however, that even if a very different predictive 
value must be placed on a particular score in terms of the group 
from which it is derived, the test as a whole continues to have con- 
siderable validity for any of the populations on which it is used. 
All that seems to happen as one moves from a raw recruit popula- 
поп to a seasoned veteran population is that scores for both normals 
and maladjusted shift upward to about the same extent. Differentia- 
tion thereby remains at a fairly constant level: 


Summary and Discussion 


Whenever different inventories have been employed on identical 
populations and then evaluated in terms of the same criterion, it 
has been striking to note how similar have been the prediction re- 
sults, In no instance has it appeared with clarity and certainty that 
а particular instrument, a particular content, or a particular format 
as decidedly superior to any other instrument, content, or format. It 
begins to appear as if psychiatric screening instruments employing 
Symptom inquiry as the basic technique had reached a plateau in 
their development. It may be anticipated that refinement of this 
technique will produce small, though perhaps significant, improve- 
ments in prediction. Major advances, however, will probably depend 
Оп radical innovations in the methods of measurement. 

ITEM CONTENT IN RELATION TO THE PSYCHIATRIC CRITERION. As а 
"easonably effective and economical instrument for psychiatric refer- 
ral purposes, the symptom-oriented questionnaire has proved its 
value. It is therefore important to observe the particular items which 
seem consistently to offer the highest validities for prediction. A 
800d many of the most significant items may be classified somewhat 
8enerally under the heading of conversion symptoms, or at least as 
having reference to the somatic representatives of anxiety and guilt. 

Imost without fail, the most valid single item in these inventories 
turns out to be one dealing with headaches. Its nearest rival, in- 
terestingly enough, is that type of item which quite straightforwardly 


quires as to whether the subject considers himself nervous to any 
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considerable degree or has been treated or has знана edi 4 
ment by a doctor for nervousness. Dizzy spells, iii ta ad Б 
stomach pains, physical debility, and similar ps nin ird 
plaints seem to hold up consistently on item ana os dig E 
are less complicated by somatic overtones are also oun in rie 
criminative but not to the same extent nor so unvaryingly as in 5 
case of the conversion symptoms. In this class will be found iier in 
dealing with dislike for being watched at work, phobic Adm 5 
difficulty in making friends or finding things to do in spare , 
et cetera. . T" 
The situation is undoubtedly a reflection of the nature o 
psychiatric screening process. After all, item analysis ти но 
keying of the test to the psychiatric examination. Those items w " а 
most closely simulate the procedures and emphases of the psych E: 
trist’s interview will generally turn up as the items of арзи 
validity. In а sense it would be perfectly justifiable to say that es 
best way to build an inventory of the type sought after here ur 
be to study the techniques of the psychiatrists rather than the i 
abilities of the subject. So long as the major object is to predict th 
psychiatric criterion, one should emphasize a study of the criterion. 
When the major object becomes the prediction of adjustment pm 
maladjustment, then the research will necessarily de-emphasize me 
psychiatric criterion and pursue careful follow-up studies of subject : 
Validity will then be determined by real outcomes rather than рте 
diction of outcomes. Me 
TEST Construction PROBLEMS. Prediction of the psychiatric с u 
terion by instruments which assess the frequencies or intensities ns 
which certain Symptoms appear is not enhanced by extensive mu А 
plication of items ог the inclusion of filler questions which serve Еч 
other purpose than to make the inventory more palatable to the ne 
ject. Ifa single general scale is used for measurement, approximate y 


10 questions seem to Tepresent a maximum beyond which validity 
is not increased. Even this may prove much longer than is actu 
necessary, 

Considerable attention has 
format in the research 


, the p 
choice format seems to offer two important advantages, the first 
which it shares with the forced-choice type of item. 

In both fo 


xmats it is possible to have random placement of t 

adjusted and maladjusted choices so that the subject is force we 
Some care to determine whether to answer t 

left or right choice, This makes imposs 


he 
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ible а careless stereotyP 


Measures of Personal Adjustment 171 


answering "down the line," which is frequently the case with yes-no 
items. 

_ A second advantage relates to the problem of item difficulty, and 
Involves a theoretical question in item analysis which has not been 
treated extensively in the literature. It is of sufficient hypothetical 
Importance to deserve some discussion. 

Items are usually selected for these inventories because of their 
Validity in predicting the criterion. A more careful selection pro- 
cedure would also take into account the intercorrelation of the 
Items, Two items with high validity coefficients may also be very 
highly intercorrelated. Unless this situation is recognized, the inclu- 
sion and scoring of both items may result in giving excessive weight 
to a single factor. On the other hand, an item which is low in 
validity may also be highly correlated with the other items of the 
test. Elimination of such an item because of a poor validity coeffi- 
cient may result in discarding an item with excellent potentialities 
as a suppressor variable. 

_ Item difficulty is undoubtedly another significant basis on which 
item selection should be predicated. By difficulty is here meant the 
Percentage of the total population answering an item in the neurotic 
ог maladjusted direction. Easy items would have few people select- 
Ing the maladjusted choice; difficult items would have a large per- 
centage of the population answering in that way. | 3 

fan inventory is designed to be effective in connection with the 
referra] of approximately 20% to 30% of the total population, then 
the most efficient items would probably be those which split the 
Population in approximately the same proportions. Difficulty indices 
9f .20 to .30 would be optimal and would probably result in sharpen- 
ng prediction within the desired referral range. 

This consideration brought the yes-no type of item under some 
Suspicion. This format frequently implies a kind of central cleavage 
in the continuum represented by the symptom which is the subject 
of Inquiry. Consider this example: 

I feel tired and played out most of the time. Yes— No 

Negative response would imply that the individual was in that 
Part of the continuum which is represented by failure to feel tired 
я any time up to half way along the path to feeling tired all the 

me, 

Manipulation of this situation is quite simple with the paired- 
Choice format, With this structure, the example item above was 


made to r 

ead: 
I get tired a little easier now 
but it never bothers me in 


I feel tired and played 
my work. 


Out most of the time. 
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By making the paired statements represent relatively — a 
tions on the scale or continuum, a great many normal in i = 
with minor symptom difficulties could now answer freely wit d 
danger of their being pulled into the neurotic response qoem 
thus build up a higher percentage of false positives. On ET : 5 
of actual experience with the above item, it can be reported : ot ем 
proved much more discriminating in its paired-choice for е vigi 
the yes-no form. Quite obviously similar manipulation ol any ! “oe 
in paired-choice form can be undertaken to make it more or les: 
difficult. . 3 

One of the major weaknesses of the Billet Qualifications Blank m 
its present form is undoubtedly a matter of item difficulty, a pus 
which became evident only after item analysis. Those items es 
the highest validities were items of such low difficulty that ene 
a very small percentage of the total population could be аан 
by their inclusion іп the scoring key. The net result so far as tota 
test scores are concerned was to give the total distribution a hes 
heavy loading of cases in the lower score range. In fact, about 78% 
of the cases in the Naval Training Center B Study had N-Scale scores 
of 0, 1, or 2 even though a 39-item key had been employed. This 
type of score spread is too limited and inflexible to produce the type 
of discrimination hoped for. In all likelihood, an alteration in ee 
difficulty of the items by changes in structure or content will resu 
in improved prediction. : 

OTHER MEASUREMENT TECHNIQUES. The theoretical weakness um 
plicit in the use of a series of symptom questions as if they repre 
sented a single, cohesive scale designed to measure a single June 
called maladjustment is quite evident. Maladjustment is manifeste" 
in a great variety of ways, and there are not necessarily high degre’ 
of relationship among the surface indications. But it must be ann 
nized that these inventories were designed as screening instrument? 
rather than diagnostic tools. For this reason, without attempt $ 
to predict for the whole range of maladjustment, they could Е 
limited quite successfully to а variety of symptoms which are reason 
ably common to the most frequent diagnostic classifications fou” 
in military screening. 

Most cases dealt with in militar у 
screening, fall within the general classification of psychoneuros!™ 
with anxiety, hysterical, and neurasthenic reactions predominan н 
Other types of neurosis, such as compulsive or obsessive pun 
psychotic reactions, or severe character disorders are much less s 
quent. It has been quite satisfactory, ah 
tory іп: single scale form with prima 


ý m ју 
y psychiatry, at least in eat? 


therefore, to employ an et 
Ty orientation in the direct 
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of the hysterical, neurasthenic, and anxiety reactions found most 
frequently as clinical problems. 

This does not mean that a series of diagnostic scales, each of 
which is specifically directed at some reasonably well defined dis- 
ability, would not improve prediction or serve a better purpose in 
the psychiatric evaluation process. The military situation places such 
high premium on brevity and simplicity that no attempt was made 
to experiment with instruments of the type represented by the 
Minnesota Multiphasic Personality Inventory. It was necessary to 
recognize that these tests would be used in high pressure situations, 
frequently by classification officers with little psychological training. 
If the future permits a more leisurely and intensive approach, 
further experimentation with diagnostic scales is certainly indicated. 

It is to be hoped, too, that further research on screening instru- 
ments will encompass additional investigation of projective tech- 
niques. The one attempt here made to escape from the symptom 
approach involved the semi-projective technique employed in the 
Social Judgments Test described earlier. Research results were 
essentially negative in the sense that prediction of the psychiatric 
Criterion was very inferior to that possible by use of a symptom 
questionnaire. Both because the technique tried was extremely ex- 
Perimental and contained many weaknesses in its own rationale, and 
also because significant validation of this type of instrument could 
?nly come from use of a different type of criterion, it should not 
be assumed that projective techniques offer no hope for better pre- 

‘clon. On the contrary, it seems likely that future improvements in 
test prediction are most apt to come from those procedures which 
are least dependent on the conscious evaluations and self-ratings 
Of the subject. [ 

Use or Suppressor VartasLes. Further investigation of the possi- 

ilities inherent in the use of a suppression key is indicated. What- 
€ver items or elements are found highly correlated with ‘the pre- 
dictive test items but uncorrelated with the criterion offer a signifi- 
cant Opportunity for improvement in validity. Such items or elements 
‘Mply that something has entered into the test which does not belong 
In terms of predicting the criterion. If the extraneous elements can 

€ measured, then they can be subtracted from the test, leaving a 
residual more purely related to the criterion than before. 

ESEARCH MrrHoporocv. All too frequently, research on the 
Validity of tests emphasizes the degree of success and neglects analysis 
of the failures, In this respect the present studies are no exception. 
lere is perhaps as much or more to be learned from the study 


ОЁ the unpredicted case as there is to be gained from the study of 
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cases accurately identified. Who are the false positives, the men 
who score in the maladjusted direction but are found quite adequate 
for military service? What are their characteristics? What positive 
adaptive mechanisms do they possess which permit successful adjust- 
ment despite the presence of many significant symptoms? Who are 
the false negatives, the men who score in the normal direction but 
prove psychologically unstable and unfit for service? What elements 
in the test or in the individual prevent detection by the measure 
ment device? These inquiries are of the utmost importance if further 
test refinement is to be accomplished. 

Certainly such inquiries may provide valuable data on whether 
it is possible to measure the adaptive adjustive elements in per 
sonality rather than just the observable weaknesses and deviations. 
Summation of symptoms present may represent but a fragment of 
the total picture. What of the assets? What of those defensive ad- 
justments which permit effective adaptation of the organism to the 
demands of the environment? This affirmative type of measurement 
may be needed to qualify or amend the results of the more negative 
type of assessment. 

Above all, it seems absolutely essential to carry on future research 
with a criterion based on actual success in adjustment rather than 
psychiatric prediction of success. So long as the criterion of PSY 
chiatric diagnosis is used, it will be a misnomer to call these in- 
ventories tests of adjustment or maladjustment. At least one must 
postpone calling them that until research has adequately established 
the validity of the psychiatric prognosis. Major progress will un- 
doubtedly be made when long term studies are undertaken which 
will proceed as follows: First backward, from the observation O 
military successes and failures to the specific etiology or charac 
teristics which differentiate such groups; then forward, from the 
measurement of such differences to the specific validation of the 
measurements in terms of actual military experience. 


PART III 
PREDICTION OF SUCCESS IN TRAINING 


CHAPTER X 


PREDICTION OF SUCCESS IN TRAINING AT 
PRIMARY OFFICER TRAINING SCHOOLS 


General Description of the Studies 


As described in Chapter IV, the schools employed in the Navy's 
wartime primary officer-training program were chiefly indoctrina- 
tion schools and reserve midshipmen’s schools. The purpose of the 
Present chapter is to present evidence on the effectiveness of psy- 
chological tests in selecting entrants into these two types of school. 
In addition, the effectiveness of tests in selecting students for the 
V-12 colleges will be considered. The V-12 colleges, toward the end of 
the war, were the principal feeder of the reserve midshipmen’s schools. 
The predictive validity of four aptitude tests and one achievement 
test is studied in the present chapter. 

І. Orricer Quauirication Test, Form 2. This is a brief (one 
hour) aptitude test devised primarily for the selection of entrants 
Ito indoctrination schools. This test was ordinarily administered 
to civilian applicants for commissions at the offices of naval officer 
Procurement; the brevity of the test was well adapted to the ad- 
ministrative requirements at the procurement offices. Я 

2. Army-Navy COLLEGE QUALIFYING TEST (Тезт C-1). This apti- 
tude test is longer than the Officer Qualification Test (two hours), 
and was devised for the selection of civilians applying for entrance 
into the V-12 college training program. : 

3. NROTC Szrrcrive EXAMINATION, Form C. This is a very brief 
aptitude test (requiring only 28 minutes of working time), which 
Was in use, prior to the war, for the selection of candidates to the 

aval Reserve Officers Training Corps. In the present chapter, a 
Study is reported of the validity of this test for selecting entrants 
into reserve midshipmen’s school. | . 

4. OrrrcEn CrassrricATIoN Testr, Form X-l. This two-hour apti- 
tude test was devised primarily for men graduating from indoctrina- 
tion or midshipmen's schools. The four scores obtained from the 
test—Verbal, Mechanical, Mathematical, and Spatial—facilitated the 
Placement of graduates into particular billets or specialized, ad- 
vanced schools. Although this test was not devised as a selection 
Measure for entrants into any primary officer-training school, it ap- 


1 This chapter į f NDRC Project N-106 and the College 
is based upon research reports 0 "ТОЈ 
папе ее Board, and upon unpublished studies of the Test and Research 
Section, Bureau of Naval Personnel (see Appendices C-1 and C-2). 
177 
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peared desirable, when the opportunity offered, to investigate the 
predictive value of this test in selecting entrants into reserve mid- 
shipmen's school. 

5. Теѕт N-4. This is a comprehensive test designed to measure 
achievement in the first semester of V-12 college training. Since most 
of the men succeeding in the V-12 college training program were 
assigned to reserve midshipmen's school, it seemed desirable to 
determine to what extent first-semester achievement in V-12 predicts 
later achievement in reserve midshipmen's school. 


The tests mentioned above are described in greater detail in 
Chapter VII and in subsequent portions of the present chapter. 

Although the predictive measures considered in the present chap- 
ter are limited almost wholly to tests, it is realized that other devices 
are also included in any practical selection procedure: physical 
examinations and interviews generally played an important part in 
naval personnel selection. In addition, performance during the first 
few weeks of a school program provides a measure which is fre- 
quently useful for predicting subsequent school success; but early 
school performance should be regarded only as a last resource, since 
much time, transportation, and expense can be saved if valid predic- 
tion is made before training has begun. 

The Criteria. Broadly speaking, the success of a selection device 
can be measured by the success of the selectees. Success, in the 
studies of the present chapter, refers to training-school success, 25 
indicated by (l) graduation or failure in the training program (a 
comparatively crude or coarse measure) and (2) by grades in the 
training-school subjects. It is recognized that the measures of training- 
school success need supplementation by measures of actual perform- 
ance in the practical duties for which the school courses provide 
background or training. The relation between success in school and 
success on the job is not, in general, sufficiently close to permit a 
measure of the one to substitute for a measure of the other. Never 
theless, the criterion of success in school has definite practical valid- 
ity, since a person who fails a training program will not, ordinarily: 
be permitted to enter the duties for which the program is the official 
prerequisite. 

Samples. 'The samples studied in the present chapter include 763 
officers in an indoctrination school; 427 waves officer-candidates і 
a women’s reserve midshipmen's school; 1,342 deck-officer-candidates 
in a reserve midshipmen’s school; and 772 students in seven Vl 
schools. An obvious limitation, with reference to generalization о 
conclusions, is the comparatively small number of schools studied— 
only one of the thirteen naval indoctrination schools operating 
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during the war, only one of the seven men’s reserve midshipmen’s 
schools, and only seven of the 131 V-12 schools. Limitations of time 
and size of staff prevented extending the scope of the studies as 
broadly as might be desired. On the other hand, the number of 
cases in each study appears large enough to justify some confidence 
11 the results. 

, The samples used in the studies of the present chapter always 
involve some selection or restriction, if only because the samples 
never include applicants who were refused admission to the training 
Schools. Another source of restriction arises when the criterion is 
School grades (rather than merely graduation vs. failure); because in 
this case the samples do not include individuals who failed or who 
(for whatever reason) were dropped from the school. The exclusion 
of failures and drop-outs is accountable on two grounds: first, quan- 
Utative school-grades are generally lacking for failures or drop-outs; 
and second, the various other data needed for a research study are, 
1n general, much more readily available for regular cases than for 
failures or drop-outs. The restriction of the samples to entrants or 
Course-survivors causes a decrease in the magnitude of the validity 
Correlations. In most instances, however, it has been possible to 
estimate a statistical correction for this effect. 

Statistical Procedures. The degree of correspondence between the 
Predictive measures and success in training-courses was measured 
by either the biserial or the product-moment correlation coefficient, 
usually the latter, 

he fact that the samples used in the studies of the present chap- 
ter are restricted to entrants or course survivors is unfortunate from 
the point of view of evaluating a predictive measure. It is desirable 
(0 know the correlation between the predictor and the criterion 
1n the total group of applicants, since the function of tests, in the 
Selection process, is more largely to determine which of the appli- 
cants should be accepted or rejected than to predict the precise 
СВтее of success of those who are accepted. The correction of the 
Validity correlations for the limited range of ability in the restricted 
Samples was accomplished by the use of Pearson’s formula, as pre- 
sented by Kelley.? M 
. Limitations of the Studies. In addition to limitations already men- 
Попед, it may be pointed out that wartime research necessarily tends 
to place greater emphasis on practical results than on well-rounded 
©omprehensiveness and theoretical depth. A consequent limitation 
of the studies reported in this chapter is the virtual absence of in- 
£y into why a particular test succeeds as far as it does but no 
arther, Similarly, all too little investigation has been made of the 
Kelley, T. L. Statistical Method, pp. 223-225. Macmillan, New York, 1924. 
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proper emphasis of tests in the total selection process. In the selec- 
tion of V-12 students, one might ask what is the relative weight that 
should be given to information from the student's high-school 
record, from psychological tests, from interviews, and from physical 
examinations. The studies available at the present time generally 
leave such comprehensive questions unanswered. An investigation 
aiming to answer some of these questions regarding the V-12 pro- 
gram is now in progress. 

In the following sections consideration will be given first to the 
prediction of success in indoctrination school, then to the prediction 
of success in reserve midshipmen's school, and finally to the predic- 
tion of success in the V-12 college training program. This sequence 
corresponds, for the most part, to the chronological sequence in 
which the separate studies were made, and to the order of peak utili- 
zation of the different types of school by the Navy. 


Predicting Success in an Indoctrination School 
by the Officer Qualification Test 


The test employed in selecting men for indoctrination school was 
the Officer Qualification Test. This test is described in Chapter VII. 
Correlation coefficients were calculated between test scores and 
grades in each of the indoctrination school courses, Seamanship» 
Ordnance, and Navigation, and also with a rating known as the 
Officer-Aptitude Rating. The aptitude rating, based on instructors 
judgments, is designed to provide an evaluation of the individual's 
“officer-like qualities,” ог the personal qualities deemed desirable 
in a naval officer. The Officer-Aptitude Rating and the grades in each 
subject were expressed on a scale from 0 to 4.0, with the passing 
mark set at 2.5. Finally, correlation coefficients were also calculated 
between test scores and the student's final average grade. The final 
average grade is an unweighted average of the aptitude rating and 
the grades in Seamanship, Ordnance, and Navigation. 

The Seamanship course included a great variety of subjects, such 
as ship organization, naval terminology, ship construction, grou” 
tackle, mooring, communication and orders, inland rules, keeping 
ship’s log, and blinker and flag signals. The Ordnance course і 
cluded the structure and function of various guns, the fire contro 
problem, and some practice in handling guns. The Navigatio? 
course, which included some trigonometry, was intended not e 
make finished navigators, but simply to insure that as junior officers 
the men would know something of what was being done during a 
watch on the bridge. 


As mentioned in Chapter VII, the validation results obtained 
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for the Officer Qualification Test may be regarded in the nature 
of pre-validation, rather than strictly formal validation. The qualify- 
ing circumstances include the following: (1) The time-limit was 
more liberal than that finally adopted. (This is not considered a 
Serious factor, because even with the shortened time-limit, scores on 
the Officer Qualification Test by no means depend primarily on 
Speed.) (2) The test was administered to the students after they had 
entered indoctrination school. (This was not considered very im- 
portant, because the rank-order of a group of men on an aptitude 
test is not, in general, seriously affected by a uniform educational 
experience.) (3) The Forms 2 and 3 administered were actually ex- 
perimental forms containing, in all, 274 items, instead of the 200 
eventually retained in the final Forms 2 and 3. The Form 2 and 
Form 8 scores used in this study represent a re-scoring of the extra- 
length experimental forms, restricted to the 100 items finally retained 
In each form. (The interpolation of extra items in the experimental 
forms is not considered a serious matter, since a special study showed 
that the item-characteristics [difficulty and item-total correlation] of 
the retained items in the final forms were practically identical with 
the characteristics of the same items in the experimental forms.) 
ESULTS. Below are listed the correlations between total scores in 
Forms 1, 2 and 3 of the Officer Qualification Test and final average 


> &, 


Brades: 


Form 1: Correlation with final average grade .51 (n = 360) 

Form 2: Correlation with final average grade .48 (n = 403) 

Form 3: Correlation with final average grade .50 (n = 403) 
The Standard deviations of Officer Qualification Test raw scores in 
the indoctrination school samples are only about .9 as great as in the 
oup of applicants at the offices of naval officer procurement. Statis- 
‘cal correction for this restriction in ability-range ? would raise the 
coefficients listed about .04 each. The figures above suggest two 
conclusions: 


l. The Officer Qualification Test is reasonably successful in predicting 


al avera Se e 1 
ge grade in indoctrination school. — Р 
Forms 15 and 3 of the Officer Qualification Test are substantially 


inpivalent with respect to validity in predicting final average grade in 
°ctrination school. 

Some interest attaches to the correlation between the Officer 
Qualification Test and the individual components of the final aver- 
tee grade, Table 1-х presents the facts for Forms 1, 2, and 3 of the 

St; the median correlation for the three forms is also given, in the 

grom line of the table. 

Kelley, p. p. ар. cit. 


fin 
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It will be observed from Table 1-х that Navigation is the subject 
for which grades are predicted best (median.r = .50); Seamanship 
is next; Ordnance, third; and Officer-Aptitude Rating, last. It is not 
surprising that the Officer-Aptitude Rating is only very poorly pre- 
dicted by the Officer Qualification Test, since this rating is based 


TABLE 1-х, Correlations between Forms 1, 2, and 3 of the Officer Quali- 
fication Test and components of the final average grade 
(Indoctrination School) 


— M 


Correlation with 


Officer Grade in Grade in Gradein — Officer-Aptitude 


Qualification Test Seamanship Ordnance Navigation Rating 
Form 1 41 Ae 42 21 
Form 2 45 34 51 07 
Form 3 47 37 50 .09 
Median r 45 37 50 09 


mainly on personal qualities—which the Officer Qualification Test 
does not attempt to measure. An additional factor tending toward 
a low correlation coefficient for the Officer-Aptitude Rating is the low 
standard deviation of the aptitude-rating distributions (see Table 
2-x). Before attempting to interpret further the data of Table 1-х, 
it will be well to take note of the comparative standard deviations 


TABLE 2-x. Means and standard deviations of course-grades and of Office" 
Aptitude Ratings (Indoctrination School) 


= 


Class 6 Class 7 
M ca Nec m 
M с м с 
Seamanship 3.3 27 3.4 30 
Ordnance 3.4 31 34 25 
Navigation 3.2 32 3.1 31 
Final Average Grade 3.3 18 3.3 20 
Officer-Aptitude Rating 3.2 -16 3.2 18 


for grades in Seamanship, Ordnance, and Navigation. These stand 
ard deviations are given (along with the means) in Table 2-X- 

standard deviations of grades in Ordnance are appreciably lowe! 
than for Seamanship or for Navigation. It is difficult to ie 1 
whether this is due to a restricted range of ability of students ir 


. . Y 
Ordnance, or to inadequate, non-differential grading. In eitht 
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event, however, the low standard deviations for Ordnance grades 
would tend to result in a lower correlation between these grades and 
the Officer Qualification Test. 

А The reliability coefficients of grades should also be considered 
in interpreting the validity coefficients of Table 1-х. For Seamanship 
and Ordnance courses, seven or eight weekly grades were obtainable 
for each man; but for Navigation, only the final average grade was 
available. Accordingly, the reliability coefficient for Navigation 
аси could not be calculated. For Seamanship and Ordnance, it 
а роо to calculate the split-half reliabilities (corrected by the 
Saati formula); these reliability coeflicients are as fol- 


Reliability of Seamanship grades in Class 6 86 
Reliability of Seamanship grades in Class 7 .92 
Reliability of Ordnance grades in Class 6 80 
Reliability of Ordnance grades in Class 7 75 


Са ime reliability coefficient for grades in Ordnance partially 

dn the lower validity of the Officer Qualification Test in pre- 
8 grades in Ordnance as compared with Seamanship. 

the О а now to the detailed correlations between each subtest of 

order EL Qualification Test and indoctrination school grades. In 
» however, to avoid an excessively large and detailed table of 

ee et the median correlation coefficients for the three forms of 
fficer Qualification Test are presented, rather than the соећ- 


T H 
ABLE 3-х, Median correlations between subtests of the Officer Quali- 
fication Test and school grades (Indoctrination School) 


Correlation with 


Gradein Gradein Grade in Final 


Subtest Seamanship Ordnance Navigation Average 
Opposites 37 27 JA .36 
€chanical Comprehension -28 29 36 35 
rithmetical Reasoning 36 29 52 46 


Cents for each form separately (see Table 3-x). The use of the 
differences in the correla- 


еЗ? 
73 ie coefficient is justified because the 2 l 
ni coefficients for Forms 1, 2, and 3 are quite small and not sig- 
ificant, dad ! 

Ms outstanding facts of Table 3-x are (1) the high correlation 
gati Gent (.52) between Arithmetical Reasoning and grades in Navi- 
se on, slightly higher than for the total Officer Qualification Test 
* Table 1-x); (2) the low correlations of all subtests with grades 
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in Ordnance; and (3) the overall superiority of the Arithmetical 
Reasoning test (correlation with final average grade = .46, as com- 
pared with .35 and .36 for Opposites and Mechanical Comprehen- 
sion). | 
IMPROVEMENT OF PREDICTION. Although the Officer Qualification 
Test is, by the evidence, reasonably successful in predicting grades 1n 
indoctrination school, still higher correlation coefficients are desir- 
able. It is conceivable that higher coefficients could be obtained 
through such means as better and more uniform instruction; OT 
through more highly valid grading of students’ work; or through а 
more uniformly high level of motivation among students. Such ave- 
nues of improvement, however, are beyond the scope of the present 
study. It remains to inquire, then, whether higher correlations be- 
tween the Officer Qualification Test and grades may be obtained by 


TABLE 4x. Simple vs. multiple correlation between parts of Officer 
Qualification Test and school grades (Indoctrination School) 


Grade in Grade in Grade in Final de 
Seamanship Ordnance Navigation Average Ста 
Officer — а. ae, | Eee 
Qualifica- Multi- Multi- Multi- Mult 
tion Test Class т рек т рек г ple R T ple R 
Foml 6 41 44 42 43 42 54 Sl 5 
Fom2 7 45 46 34 35 51 57 48 5l 
Fom3 7 47 47 387 39 50 .57 50 55 


improvement of the test itself, or by improved use of scores from m 
separate parts of the test. 

The question at once arises whether improved correlations can 6 
obtained by differential weighting of the subtests. The maximu”, 
improvement which could be expected from altering the weights 0 
the three parts can be ascertained by computing the multiple сое 
lation of the three part-scores with the criteria, and comparing thes? 
multiple correlations with the simple, or original, correlation” 
Table 4-x presents such comparisons. ; је 

Table 4-x may be interpreted several ways. If the ideal multiple 
regression weights were determined and applied, it appears — 
grades in Seamanship and Ordnance would not be predicted s 
preciably better; but grades in Navigation would be predicted mo 
accurately (the correlation coefficient rising from a median " ‘pe 
toa median R of .57); and the final average grade would also 
predicted more accurately (the correlation coefficient rising 19, os 
median r of .50 to a median R of .55) It may be questioned wheth 


Primary Officer Training 185 


such gains are worth the extra trouble in applying the special 
Weights (or approximations) required by the multiple regression 
equation. The weights are not, of course, identical for predicting 
grades in Navigation as for predicting final average стаде. Since the 
Arithmetical Reasoning subtest is the most valid of the three parts 
of the test (Table 3-х), it might be better from a practical point of view 
merely to increase the number of items in this test (thus increasing its 
relative weight). If this were done, it would be necessary to shorten one 
or both of the remaining subtests in order to remain within the one- 
hour limit fixed for the Officer Qualification Test. 

The Mechanical Comprehension subtest is only moderately valid 
for predicting indoctrination grades (Table 3-x); but the lack of a 
high reliability coefficient for this subtest suggests that increasing 
the number of items in Mechanical Comprehension might improve 
Its validity perceptibly. Taking the reliability coefficient of the later 
forms of the Mechanical Comprehension subtest as .75, it is esti- 
mated + that doubling the length of the Mechanical Comprehension 
test would raise its correlation with grades in Seamanship from 28 
to .30, with grades in Ordnance from .29 to .31, with grades in Navi- 
Bation from .36 to .38, and with final average grade from .35 to .37. 
Evidently, merely increasing the length of the Mechanical Compre- 

Ension test will not appreciably improve its validity. — 

Probably the validity of predicting both indoctrination school 
Srades and Officer-Aptitude Ratings could best be improved by the 
Addition of a test or questionnaire having a low correlation (about 

) with the Officer Qualification Test and a definitely positive 
correlation (about .25) with the criterion. The addition of such a 
test would Taise the correlation between the Officer Qualification 

est and final average grade from about .50 to 558 A personality 
ME or questionnaire relating to personal and biographical back- 
i ounid might best be able to fulfill the statistical requirements for 
the p Pothetical validity-rise from 50 to .55. If ee 

‘Aree subtests of the Officer Qualification Test are employed, 
Median correlation between Officer Qualification Test and final 
average grade is itself .55 (Table 4-х); addition of a successful per- 
elias or background measure such as described above, would raise 
MS Validity-correlation to .59. . . 
tios, 2PPlication of multiple-regression vene bem 
the 5) is Somewhat troublesome; and the possi уа iq: ea 
Previous paragraph would definitely require the use of su 
vae din a, 


оар, J. W., and Kurtz, A. К. Handbook of Stati: 7 
ulas, p. 31, formula 391. World Book Co., Yonkers, N. Y» 


J. P. Psychometric Methods, p- 422, formula 202. McGraw-Hill, New 


stical Nomographs, Tables, and 
1932. 
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ibili ise i idi rom .50 
weights. Nevertheless, the possibility of a rise in validity endet 
to ,59 is sufficiently attractive to justify serious attention to wha 


in the way of 
clerical or machine-scoring procedures seem to stand in the way 
such a rise. 


Predicting Success in a Reserve Midshipmen's School 
(Women's Reserve) by the Officer Qualification Test 


PREDICTIVE MEASURES AND CRITERIA. Forms 2 and 3 ° of the ane 
Qualification Test were administered to three companies of у 
officer-candidates at a reserve midshipmen’s school (women’s E din 
The present section will consider evidence on the validity o veci 
Officer Qualification Test, as determined by correlations bety 
the test and course-grades. . d Basic 

The courses taken by the waves officer-candidates include а 
Indoctrination and either Communications or Advanced Indoctr!! 


^ $ in the 
tion. Each of these courses embodied four subjects, as shown 1n 
following outline: 


Basic Indoctrination (symbolized by "I"): 
Ll (a) Organization 
(b) Naval Law 
(c) Naval. Correspondence 
L2 Personnel 
I-3 History and Strategy 
I-4 Ships and Aircraft 


Communications (symbolized by “G”): 
C-1 Naval Communications (General) 
C-2 Fundamentals of Radio 
C-3 Codes and Ciphers 
С-4 Touch Typewriting 


Advanced Indoctrination (symbolized by “А”): 
А-1 (a) Organization 
(b) Communications 
. А-2 Personnel 
A-3 (a) History and Strategy 


(b) Correspondence and Filing 
A-4 Ships and Aircraft 


nie’ 
Of the three companies included in the present study, Comp? 


тра"? 
1 and 2 took Basic Indoctrination and Communications. Со sped P 
6 These were experimental forms of the Officer Qualification Test, descr 
Chapter VII. 
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6 took Basic and Advanced Indoctrination. The numbers of officer- 
candidates tested in each of these three companies were, respectively, 
152, 160, and 115, 


А Resunrs. Table 5-x gives the correlations between Forms ? and 
? of the Officer Qualification Test and students’ final average grades. 


The median of the correlations is under 40, which is notably lower 
han the median of .50 observed in the sample of indoctrination 
school students, 

For wie! 1, the final average grade was conhe PR 
formula, a E (where "I" is final grade in Basic Indoctrination, 


and "C" is final grade in Communications); for Company 2, the 


final average grade was determined by the formula, LL for 


T. H > 
T LE 5-х, Correlations between Forms 2 and 3 of Officer Qualification 
Sst and final average grade (Women's Reserve Midshipmen's School) 


Correlation with Final Average Grade 


Officer 

Qualifica- Companies 1 and 2! Company 62 

tion Test (N = 312) N — 115) 

Form 2 :35 :39 

Form 3 .37 47 

1^ 

ton DR two companies took Basic Indoctrination and Communications; each correla- 
means parlent listed is the arithmetical average of the 7's for the two companies. T he 
Standar 9r the two companies in final average grade were 3.21 and 3.23, respectively; the 
the on. deviations were .20 and 221, respectively. The mean and o of raw scores on 
Tespectively fication Test (for Companies 1, 2, and 6 combined) were 55.5 and 10.9, 


C 
Brades gba Y 6 took Basic and Advanced Indoctrination. The mean of final average 
b Company 6 was 3.26, the g was .22. 


ade was determined simply by 
d Advanced Indoctrination. All 
0 to 4.0, with the passing mark 


Co 
a rud 6, the final average gr 
Sing final grades in Basic an 


Brades 
Were е 
Set at 2.5. xpressed on a scale from 


i. ОЁ interest to note the correlations between the Officer Quali- 
grade > Test and the individual components of the final average 
Office Table 6-x presents these figures, for Forms 2 and 3 of the 
ен Qualification Test; the average correlation coefficient for 
abe omis is also given. LY T . 8 

the Об -x shows that Communications is the subject with whic 
= 2 cer Qualification Test has the lowest correlation (average 7 
in " 9). The reason for this low correlation coefficient does not lie 
n Exceptionally low standard deviation of grades in Communica- 
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tions (see Table 7-x). The low correlation is in general accord with 
other findings of low relationship between scores on general apti- 
tude tests such as the Officer Qualification Test, and grades for the 
learning of such subjects as radio code and typing. 


TABLE 6-x. Correlations between Forms 2 and 3 of Officer Qualification 
Test and components of final average grade 
(Women's Reserve Midshipmen’s School) 


Correlation with Grades in 


Officer Basic Advanced 
Qualifica- Indoctrination Communications Indoctrination 
tion Test (N = 427)! (№ = 312)? (N = 115)? 
Form 2 .40 .28 34 
Form 3 43 30 A 
Average r 42 29 38 


1 Average of correlation coefficients for Companies 1, 2, and 6. The use of an average 


r is justifiable, since (ће 75 for the different companies do not differ significantly from 
each other. 


2 Average of correlation coefficients for Companies 1 and 2. 
3 Based on Company 6 only. 


Since the reliability coefficients of grades in the different courses 
are pertinent to interpretation of the correlations in Table 6-х, ай 
attempt has been made to estimate these reliabilities. Because weekly 
grades were not available, the technique of correlating the sum of 


Taste 7-х. Means and standard deviations of grades in Basic Indoctrin® 
tion, Communications, and Advanced Indoctrination 
(Women's Reserve Midshipmen's School) 


Course M с 
Basic Indoctrination ! 3.3 425 
Communications ? 3.9 2) 
Advanced Indoctrination 3 3.3 21 


1 Average of values for Companies 1, 2, and 6. 
2 Average of values for Companies 1 and 2. 
3 Values for Company 6 only. 


odd-week grades with the sum of even-week grades could not ps 
applied. Fortunately, grades for each of the four subjects within a 
course were obtainable; accordingly, the sum of grades in two pe 
jects within a course was correlated with the sum of grades in - 
other two subjects, and the Spearman-Brown formula was then ap 
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plied. For Basic Indoctrination, the sum of grades in 1-1 апа 1-3 
Was correlated with the sum of grades ір I-2 and 14. For Communi- 
cations, the sum of grades in С-1 and С-3 was correlated with the 
sum of grades in C-2 and C-4. For Advanced Indoctrination, the 
Sum of grades in А-1 and A-3 was correlated with the sum of grades 
in A-2 and А-4. The resulting reliability coefficients * are as follows: 


Reliability of Basic Indoctrination grades in Co. 1 82 
Reliability of Basic Indoctrination grades in Co. 2 -87 
Reliability of Basic Indoctrination grades in Co. 6 87 
Reliability of Communications grades in Co. 1 63 
Reliability of Communications grades in Co. 2 69 
Reliability of Advanced Indoctrination grades in Co. 6 -70 


The differences among the reliability coefficients are not sufficient to 
account for the differences among the validity coefficients of Table 
6x, especially since the lowest reliability coefficients (for Communi- 
cations) probably represent a serious underestimate of the true 
reliability, 


Taste 8-x. Average correlations between subtests of Officer Qualification 
Test and course grades (Women's Reserve Midshipmen’s School) 


Correlation with Grades in 


Basic Communi- Adv. Final 
Indoc. cations Indoc. Average 
Subtest N = 427)! (N= $12)2 (N = 115)3 (N = 427)! 
OPposites 34 18 32 29 
chanical Comprehension 25 21 -10 .20 
34 28 36 4 


Arithmetical Reasoning 


rms 2 and 3, in Companies 1, 2, and 6. The 


1 Avera 
г the 75 for the different forms nor the 


use 
diffe 


of ae of correlation coefficients for Fo 
renf eee r is justifiable, since neithe. 
pes mpanies exhibit significant differences. " ip and 

*rage of correlation coefficients for Forms 2 and 3, in Companies 1 and 2. 


Verage of correlation coefficients for Forms 2 and 3, in Company 6. 


We turn next to the detailed correlations between each subtest of 


~ Officer Qualification Test and course grades. In order, however, 
2 avoid an excessively large and detailed table of data, only the 
erage correlations for the two test forms, and for the various com- 
ns Will be presented (Table 8-x). | | 
ће use of a split-half correlation and 


i9 : 
у ;Pblication of the Spearman-Brown formula аге only very roughly fulfilled here. 
ара cular, the subjects matched in the odd and even halves of Communications, 
шепа) munications (General), and Codes-Ciphers i 
5 of Radio and Touch Typewriting in the even 


Ments арр А л 
соста larity and comparability. This res 
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The two outstanding facts in Table 8-x are (1) the comparatively 
low correlation coefficients yielded by the Mechanical Comprehen- 
sion subtest and (2) the comparatively low correlation coefficients 
for grades in Communications (see also Table 6-x). 

IMPROVEMENT OF PREDICTION. Since the validity coefficients of the 
Officer Qualification Test for waves officer candidates are not suffi- 
ciently high to be considered satisfactory, some possible means of 
improvement may be mentioned. (1) A small but possibly worth- 
while improvement in validity (roughly .05) could be gained by 


TABLE 9-x. Simple vs. multiple correlation between Officer Qualification 
Test and course grades (Women's Reserve Midshipmen's School) 


Correlation with 


Basic Advanced Final 
Indoctrination Communications Indoctrination Average 
Grades Grades Grades Grades 
Officer a 
Qualifica- Com- Multi- Multi- Multi- Multi- 
tion Test pany r рев r рек r ple R т рек 
Form 2 1 40 40 24 34 .33 .38 
Form 2 2 41 49 3134 37 -38 
Form 2 6 39 49 4  .89 .89 46 
Form 3 1 42 äs 94 .36 .34 -40 
Form 3 2 41 45 36 .38 40 42 
Form 3 6 47 55 41 46 47  .58 
Average Cor- 
relation 42 46 29 36 38 42 38 43 


applying multiple-regression weights to the individual subtests of 
the Officer Qualification Test (Table 9-x). (2) Another source of 
improvement might be the substitution of a clerical ability test 10 
place of the Mechanical Comprehension subtest. (Eliminating Lom 
Mechanical Comprehension subtest would not reduce the validity 
of the Officer Qualification Test in the sample of wAves.8) Finally 
(3) the addition of a test relating to personality or biographical back- 
ground or both might also be advantageous. 


8 The following figures support this statement: the multiple correlation between final 
average grade on the one hand, and Opposites, Arithmetical Reasoning, and Mechanica 
Comprehension on the other, is .43; the multiple correlation, omitting Mecha? 
Comprehension, is practically the same, 42. Similar multiple correlation coefficients a- 
the separate courses taken by the WAVES students are as follows: for Basic дос 
tion, 46 compared with 45; for Communications, .36 compared with .32; and 
Advanced Indoctrination the correlation was .42 for both cases, 
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Predicting Success in a Naval Reserve Midshipmen’s School (Deck) 


The study to be reported below is based on 1,342 deck-officer- 
candidates in a class at a naval reserve midshipmen’s school. This 
class convened on July 5, 1944. All but a few of the candidates had 
qualified for reserve midshipmen's school through training in the 
Navy's V-12 college program. | 

Prepicrive Measures. The purpose of the study is to determine 
the validity of various measures available for selecting entrants to 
reserve midshipmen's school. The predictive measures employed are 
as follows: 


1. Officer Qualification Test, Form 2. 
2. Officer Classification Test, Form Х-1. 
3. NROTC Selective Examination, Form C. 
4. Test N44. , 
5. Average grade during Indoctrination (a three-week period preceding 
the two regular terms of reserve midshipmen's school). 
Of the five measures listed above, the first two have already been 
described (Chapter VID. The NROTC (Naval Reserve Officer 
raining Corps) Selective Examination, Form C, is composed of 
four tests. 'The first test, Multiplication, consists of one hundred 
Simple multiplication problems (two-place numbers multiplied by 
one-place numbers); four minutes are allowed for this test. The 
Second test is Block Counting; again, four minutes are allowed. The 
third test is the familiar vocabulary test (a key word is given, and 
the examinee selects from five alternatives the one which means the 
Same as the key); time allowance, five minutes. The fourth and last 
test is Arithmetical Reasoning; time, fifteen minutes. Test N-4 is 
а comprehensive, five-hour general achievement test administered to 
V-12 students at the beginning of their second semester. The indoc- 
trination grade is the average of grades for the three-week indoctri- 
nation period in Navigation, Ordnance and Gunnery, Seamanship, 
and Damage Control. Grades are expressed on the usual Navy 0-4.0 
Scale. Each subject was weighted 2, except Damage Control, which 
Was weighted 1. Ed m 
CRITERIA. As criteria by which to test the validity of the predictive 
Measures described above, use was made, first, of the final academic 
Average; and second, of graduation vs. failure. — : І 
е final academic average іп reserve midshipmen’s school is 
ased on academic grades during the three periods into which the 
Complete course is divided: the indoctrination period (three weeks), 
‘he first term of reserve midshipmen's school (six weeks), and the 
Second term of reserve midshipmen’s school (six weeks). The average 
9 grades during the indoctrination period is combined with enn 
"ring the first week of the regular term to form the first “weekly 
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grade." At the end of each of the six-week terms, a term-grade is 
determined in each subject, by giving the average of weekly grades 
a weight of 2, and the final examination of the term a weight of 1. 
The final grade in each subject is obtained by averaging the two 
term-grades. The final academic average is obtained by averaging 
the subject-grades for the two six-week terms, giving each subject a 
weight as follows: Navigation, 2; Ordnance and Gunnery, 2; Sea- 
manship and Communications, 2; Damage Control, 1; and Recog- 
nition Training, 1. 

The graduation уз. failure criterion distinguishes merely between 
those who passed, and those who failed for academic reasons. Of the 
total academic failures, about 80 per cent are dropped at the end of 
the first three-week (indoctrination) period. At this time the men 
are advanced from apprentice seamen to the status of midshipmen. 
In general, if a candidate had received a failing mark in more than 
one of the indoctrination-period subjects, he was retained only if his 
aptitude test scores indicated a reasonably high level of ability and 
if there appeared to be extenuating circumstances, such as extensive 
hospitalization, to explain his unsatisfactory work. Ratings of officer- 
aptitude were also taken into account. College transcripts, contain- 
ing V-12 records, were consulted in special cases, but they were not 
used regularly because standards among institutions were found to 
vary, and the records lacked uniformity. No use was made of C-test 
or N-test scores in deciding whether to retain a student. 

The Officer-Aptitude Ratings mentioned above are ratings prima- 
rily of the various personal qualities (as distinguished from intellectual 
abilities) deemed important for naval officers. The Officer-Aptitude 
Rating has not been included as a criterion in the present study for 
several reasons: (1) the available internal evidence is not reassuring 
as to the validity of the ratings: 80 per cent of the ratings fall within 
3.2 and 3.4, inclusive, and the standard deviation of the distribution 
is quite small (.13); (2) the predictive measures in the present study 
are designed primarily as measures of ability, not personality; and 
(3) the correlation between grades and the school's over-all evaluation 
of the candidate (the final multiple grade) is .97, so that very little !5 
lost by excluding the Officer-Aptitude Ratings. 

The comparative weight of course grades, aptitude test scores, and 
Officer-Aptitude Ratings in deciding whether a candidate was to P 
passed or considered an academic failure has not been studied. NO 
doubt course grades played a major role; but aptitude test scores ап 
Officer-Aptitude Ratings were also taken into account, especially 
doubtful cases. Because of the school authorities’ familiarity Wi 
and confidence in the NROTC Selective Examination, this test yas 
given greater weight than other aptitude measures in determinin 
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еи а candidate was to be retained in the reserve midshipmen's 
vs — x eins To the extent that aptitude test scores were used 
fall and ine arg or separation, the correlation between pass- 
Bee aptitude test scores may be considered spuriously high. 
hz m the point of view of validating the aptitude tests, it would 
c id better had the test scores not been consulted when the 
€cision was being made to pass or fail a candidate. 

coL ERU The principal findings of the study of reserve midship- 

are given in Table 10-x. This table shows the correlations be- 


TABLE ; " r 
ABLE 10-x. Correlations between selection measures and final academic 
average (Reserve Midshipmen's School [Deck]) 


Correlation 
with Final 
Selection- Measure Academic Average! 

NROTC Selective Examination, Form C 46 
Officer Qualification Test, Form 2 45 
Officer Classification Test: Verbal + Math. 52 
Officer Classification Test: Verbal 35 
Officer Classification Test: Mechanical 2 
Officer Classification Test: Mathematical 49 
Officer Classification Test: Spatial 29 
Test N-4 (V-12 Comprehensive Objective Test) 54 
.80 


Average Grade for Indoctrination Period 


1 
Nod, v correlation coefficients are based on 1,109 cases, except the coefficient for Test 
record iss is based on 639 cases. The reasons for this exception are, first, that the N-test 
those ен always available at the reserve midshipmen's school; and second, that 
est NA, PE the reserve midshipmen's school directly from the Fleet had never taken 


fen the various selection measures and the criterion of final aca- 

on the imum The correlation coefficients in this table are based 

men's 109 cases graduating in a single class of the reserve midship- 
School. 

eoe 10-х may repay some scrut 

the ini nt is between final academic a 
1tial three-week indoctrination per 


а ver . " А 
У serviceable degree of relationship. 


а Tw 
at i Sees 
Indoctrination grades provided a princ 


from ү а 
i he midshipmen's school. This implies 


In ing А 
ос i : 
Teduce (пацов grade than it was before, i 
€ correlation between indoctrination grades and final academic averages. On 


fering hand, it will be recalled that the average of grades during the indoctrination 
his mee the principal component of the first “weekly grade” of the regular term. 
that th ans that the indoctrination grade entered into the final academic average, 50 
Weight © Correlation of .80 represents a small amount of self-correlation. (The nominal 
ас indoctrination grades in the final academic average is 1/24) No precise 
Nation of the net effect of the two counterbalancing influences seems called for. 


iny. The highest correlation 
verage and average grade for 
iod. This correlation is .80, 
э [t would be highly desir- 


© technical considerations affect the correlation of .80. First, it will be recalled 
ipal basis for eliminating academic failures 


that the remaining sample was less variable 
and such a reduction in variability tends to 
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able, however, to predict success in reserve midshipmen’s school at 
a time earlier than the end of the indoctrination period. The next 
highest correlation coefficient in Table 10-x is for Test N-4 (.54). 
Test N-4, normally coming early in the student's second semester of 
the V-12 college training program, provides prompter information 
than indoctrination grades, but this is at the cost of a drop in the 
correlation coefficient from .80 to .54. The Officer Classification 
Test, being an aptitude test, can be administered before the student 
has begun his V-12 college work? The Mathematical score on this 
test yields a validity correlation of .49, the Verbal score, a correlation 
of .35, and the simple sum of Mathematical and Verbal scores," a 
correlation of .52. This last correlation coefficient is practically as 
high as that for Test N-4. Beside the possibility of early administra- 
tion, a further advantage of the Officer Classification Test is that the 
Mathematical and Verbal sections of this test together require only 
65 minutes of working time, whereas the N-test requires 5 hours. 

It is possible that selected portions of the N-test, like the selected 
parts of the Officer Classification Test, might also yield a satisfactory 
correlation with the final academic average. Unfortunately, the rela- 
tion of part-scores of the N-test to the final academic average was not 
investigated. In any case, the Officer Classification Test would still 
have the advantage of being suitable for earlier administration. 

In the present sample the Officer Classification Test was adminis- 
tered to students at the beginning of their stay in the reserve mid- 
shipmen's school; whereas the N-test was administered on November 
30, 1943 (seven months earlier). It is doubtful that such a compara- 
tively brief time-interval would (for an aptitude measure such as the 
Officer Classification Test) appreciably affect the correlation with 
final average grade. The possibility of such an effect, however, might 
well be investigated. 

The correlation of .46 for the NROTC Selective Examination 
with final academic average is interesting, since the NROTC test 
is so very brief, requiring only 28 minutes of working time. In 
another study of the NROTC test, similarly favorable results were 
obtained: a correlation of .49 with grades in a deck officers’ school 
(N = 216), and a correlation of .51 with grades in an engineering 
officers’ school (N = 193). But there is no particular advantage 1” 


10 A separate test, the Army-Navy College Qualifying Test (or C-test), was develope? 
for admission to the V-12 program (see Chapter VII and page 202 of this chapter); ken 
none of the students in the reserve midshipmen's class of the present study had ta 
the C-test, having entered college before the first administration of the test. rd 

11 Scores on the parts of the Officer Classification Test are expressed on a standar, 
score scale, in which the mean of an unselected or standard sample of students іП d 
doctrination or reserve midshipmen's schools equals 50, and the standard devia 
equals 10. 
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extreme brevity when time is available for a test which can give 
more reliable results or a wider variety of useful subtest scores. 

To what extent can the results in Table 10-x be improved by 
combining various test-scores? The following two multiple correla- 
tion coefficients indicate the answer to this question: 


Let 1 = final academic average 
2 = score on NROTC Selective Examination, Form C 
3 = score on Verbal + Mathematical sections of the 


Officer Classification Test 
4 = average grade for the indoctrination period 
Then К,љм = .816 (the simple correlation, 7,4, equals .80) 
Ка = 548 (the simple correlation, 7,,, equals .52) 


These multiple correlation coefficients discourage the hope that the 
Combining of scores from different tests will yield sufficient increase 
in validity to justify the extra time and expense. 

The general conclusion from the findings set forth above would 
seem to be that if an early prognosis of performance in reserve mid- 
shipmen’s school is desired, the Mathematical and Verbal sections 
of the Officer Classification Test are the most serviceable. 

he recommendation of the Officer Classification Test for the 
Prognosis of scholastic achievement in reserve midshipmen’s school 
raises the question of the relation of this test to the C-test (used in 
Selecting candidates for the V-12 program). The salient fact in this 
connection is that the C-test was used in a situation where the 
rejection rate was high; applicants for the V-12 college training pro- 
Bram were numerous, and the average level of mental ability was 
below the standard deemed suitable for the program. The C-test, if 
Only for practical reasons, needed to be considerably easier than the 
Officer Classification Test. There was no point, however, in accept- 
115 students for the V-12 program if they could not succeed in later 
‘raining; and this later training took place, most commonly, at the 
Various reserve midshipmen’s schools. From this point of view, the 
Cer Classification Test might have proved useful as a means of 
checking up on borderline or doubtful cases. For such purposes, the 
flicer Classification Test (or, at least, the Mathematical and Verbal 
Parts of this test) could have been administered at the offices of naval 
Rer Procurement at the time that the У-12 applicant came Ei 
th Physical examination and interview. It is necessary to remember 
ас the present study is based on deck-officer-candidates in a reserve 
midshipmen’s school, The Officer Classification Test might prove 
“SS successful as a selective or verifying measure for students who 
Man to go from V-12 training to a supply corps school, or to a pro- 
*ssional School for chaplains, dentists, or doctors. 
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We turn now to an examination of results according to the second 
criterion, that of graduation vs. failure. Tables 11-x through 14-x 
show the distributions of test scores for those who graduated, and 
for those who failed (for academic reasons) in the reserve midship- 
men’s school. In each case the test scores for the academic failures are 
on the average considerably lower than for the graduates; but the 


TABLE 11-х. Scores on NROTC Selective Examination (Form. C), for 
graduates and for academic failures (Reserve Midshipmen's 
School [Deck]) 


Number of 


Number of Academic 
Score Graduates Failures 
220-229 2 
210-219 2 
200-209 1 
190-199 8 
180-189 30 
170-179 58 2 
160-169 91 
150-159 157 4 
140-149 176 12 
130-139 186 20 
120-129 147 93 
110-119 113 37 
100-109 76 37 
90-99 34 27 
80-89 14 30 
70-79 7 17 
60-69 5 13 
50-59 2 6 
40-49 1 
30-39 3 
20-29 1 
N 1,109 233 
M 137.5 103.4 
с 24.4 26.1 


overlap of the distributions emphasizes the desirability of pushing 
validity coefficients beyond the level reached by even the best 0 
current tests. 

It is generally recognized that shortcomings in a criterion may 
adversely affect the correlation between a test and the criterion: 2, 
elaborate study of the validity of grades in the. reserve midship™ 
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school of the present study could not be undertaken. At least with 
Tespect to stability from one semester to the next, however, the 
grades in the reserve midshipmen's school appear satisfactory: COY- 
relations between first- and second-semester grades in Navigation, 
Seamanship and Communications, Ordnance and Gunnery, and 
Damage Control range from .67 (for Navigation) to .77 (for Ord- 


TABLE 12-х. Scores on Officer Qualification Test, for graduates and for 
academic failures (Reserve Midshipmen's School [Deck]) 


Number of 
Number of Academic 

Score 1 Graduates Failures 
74-76 1 
71-73 2 
68-70 9 
65-67 12 
62-64 18 
59-61 36 1 
56-58 59 2 
53-55 85 4 
50-52 139 12 
47-49 141 10 
44-46 189 27 
41-43 170 35 
38-40 150 49 
35-97 57 38 
32-34 31 38 
29-31 8 14 
26-28 1 3 
23-25 1 

N 1,109 235 

M 46.5 39.6 

d 7.56 6.12 

T Scores are expressed on a standard score scale, in which the mean score of an 
equals 590 or standard sample of applicants at the offices of naval officer procurement 
» and the standard deviation equals 10. 


pance and Gunnery). These correlations are based on a sample of 
Cases, randomly selected from the graduates of a single class. 

Ta 1 а means of summarizing the data of Tables 11-х through 14-x, 

(s € 15-х is presented. Table 15-х gives the biserial correlation 

м) between test-scores and the criterion of graduation vs. failure. 

i di biserial correlation coefficients range from .30 (for the Mechan- 

al section of the Officer Classification Test) to .68 (for the NROTC 
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Selective Examination, Form C). For convenience in comparison, 
the product-moment correlation coefficients of Table 10-x, based 
exclusively on those who graduated, are included in Table 15-x. The 
high value of ты, for the NROTC test is probably due, as has been 
previously explained, to a comparatively heavy weighting of scores 


Taste 14-х. Raw scores on Test N-4 (V-12 Comprehensive Objective 
Test), for graduates and for failures (Reserve Midshipmen's 
School [Deck]) 


Number of 
Number of Academic 

Raw Score Graduates Failures 
675-699 1 

650-674 

625-649 

600-624 1 

575-599 2 

550-574 1 

525-549 7 

500-524 7 

475-499 16 

450-474 17 

425-449 37 

400-424 37 1 
375-399 54 9 
350-374 78 5 
325-349 100 12 
300-324 100 17 
275-299 68 19 
250-274 61 22 
225-249 33 31 
200-224 19 21 
175-199 5 А 18 
150-174 5 

N 639 160 
M 341.1 264.0 
c 74.6 59.0 


from this test when deciding whether to separate or to retain a stu- 
~ E at the end of the three-week indoctrination period. The reason 
the | comparatively high value of ћи for the Spatial section of 
is fficer Classification Test is not known. A possible hypothesis 

that a curvilinear relation exists between ability on this test and 
Scholastic succcess in reserve midshipmen's school—the hypothesis 
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being, further, that beyond a certain minimum spatial ability, the 
advantage of additional ability is small; whereas below a certain 
level, the disadvantage is significant. Such a situation would lead 
to a higher value of the biserial correlation for the total group (in- 
cluding both failures and graduates), than of the product-moment 
correlation for the group of graduates only. This hypothesis, of 
course, requires experimental verification. 

RECOMMENDATIONS. The main recommendations from the present 
study have already been indicated. Of the various measures investi- 
gated, the three yielding the most serviceable prediction of final 
average grade in reserve midshipmen's school are (1) average grade 
during the three-week indoctrination period, (2) score on the N-test 


"TABLE 15-х. Biserial correlation between test scores and the criterion 

of graduation vs. failure—together with product-moment correlations 

between test scores and final academic average (Reserve Midshipmen 5 
School [Deck]) 


—— 


Biserial r Product-Moment 
with Criterion r with Final 
of Graduation Academic 

vs. Failure Average 

Test (N =1,342) (N = 1109)! 
NROTC Selective Examination, Form C .68 46 
Officer Qualification Test, Form 2 50 45 
Officer Classification Test: Verbal + Math. 56 52 
Officer Classification Test: Verbal 38 35 
Officer Classification Test: Mechanical .30 4277. 
Officer Classification Test: Mathematical .55 .49 
Officer Classification Test: Spatial .46 .29 
Test N-4 (V-12 Comprehensive Objective Test) — .57 54 


1See note to TABLE 10-x. 


(administered early in thé second semester of the V-12 program). 
and (3) a score based on the Mathematical and Verbal sections of the 
Officer Classification Test. The results from multiple correlation dis 
courage the hope that combining scores from different tests will yiel 

sufficient increase in validity to justify the extra labor and expense 
For an early prediction of final academic average in reserve midsh!p- 
men's school, the Officer Classification Test is the most useful. The 
average grade during the three-week indoctrination period Las 
the most accurate prediction, but indoctrination grades are not ava? 

able until the candidate is on the very threshold of entrance i 
reserve midshipmen’s school. It is quite possible that a test or que 
tionnaire relating to the candidate's personality or biographiC? 
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background would prove a useful addition to the aptitude and 
ability measures studied in this section. 


Predicting Success in the V-12 College Training Program 


The Navy V-12 college training program may be described as a 
program at the рге-оћсег level. The program provided appropriate 
college training to qualified high school graduates who, upon suc- 
cessful completion of four or more semesters of college work, were to 
be trained as officers in the U. S. Naval Reserve. The first input of 
men into the V-12 program took place on July 1, 1943. This first 
input included (1) men who were in the earlier V-l, V-5, and V-7 
college programs, in inactive reserve status; (2) Army Enlisted Re- 
Serve Corps enrollees who expressed a preference for naval service; 
(3) enlisted men entering the program from active duty in the Navy; 
and (4) civilian high school graduates. Enlisted men in the Navy 
were admitted to the V-12 program on recommendation of their 
Commanding officers; among the requirements for recommendation 
were an examination for physical fitness, graduation from high 
school, and a score of at least 85 on the old (O’Rourke) Navy Gen- 
eral Classification Test or 110 on the Marine Corps General Classifica- 
Поп Test (after the new Navy General Classification Test became 
available, a score of at least 58 was required on this test). The selection 
Process for civilian high school graduates included a number of steps, 
as follows: (1) the Army-Navy College Qualifying Test (Test Сл); 
(2) a physical examination; (3) an evaluation of the candidate’s pre- 
vious high school (or college) record; (4) interviews by two officers at 
ап office of naval officer procurement; and finally, (5) an evaluation of 
all the collected information about the candidate by a committee 
composed of an educator, a naval officer (a senior officer at the office 
of naval officer procurement), and a “good common-sense civilian.” 

The primary purpose of the present section is to consider the 
Validity of the Army-Navy College Qualifying Test (Test C1) for 
Predicting scholastic success in the first semester of V-12 training. 
Attention will also be given to a comparison of performance of 
high school graduates from civilian VS. enlisted status. All data are 
limited to men entering in the “first increment” (July 1, 1943). It 
should be emphasized, at the outset, that the study of the C-l test 
and the V-12 college training program is still in progress, so that 
the present account can be no more than preliminary. But a limited 
number of questions will be answered, at least tentatively; and a 
more complete presentation will be available later. . 

. Prepictive MEASURE AND CRITERIA. Test C-1, the college qualify- 
Ing test, is a two-hour examination divided into four sections, which 
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may be designated as Verbal, Science, Reading, and Mathematical. 
Examinees were advised to spend 30 minutes on the first section 
(Verbal), and 30, 25, and 35 minutes, respectively, on the other three 
sections. For a more detailed description of Test C-1, see Chapter 
УП. 

The criteria against which the validity of the C-test has been 
studied include: (1) scores on a comprehensive objective test, Test 
N-4, administered a few weeks after the end of the first semester of 
V-12 training; and (2) the first-semester average grade. Both the 
N-4 test scores and average grades were expressed on а scale 
running from 0 through 10. 

The first-semester average grade is based on grades in the fol- 
lowing subjects: Mathematics (algebra and trigonometry), Physics, 
English, History, Engineering Drawing, and Naval Organization. 
Although no directive on the matter was issued by the Bureau of 
Naval Personnel, most colleges appear to have weighted the various 
grades according to the number of “contact hours” for each subject 
—namely, 5, 4, 3, 2, 2, and 1, respectively. 

The N-test is a five-hour examination divided into English (100 
minutes), Physics (50 minutes), Mathematics (90 minutes), and 
History (60 minutes). The sections on Physics, Mathematics, and 
History were designed as broad general-achievement tests in these 
subjects. Since they were administered in all the V-12 colleges (131 
in number), thes 


phasis in any local curriculum. The test in English included (1) 
a subsection on 
superfluous terms and phrases in an exposition 


a subsection on paragraph reading (25 minutes); 
д re 


It may be observed tl 
subsections of the N-test 


venient to isolate the score on the two Overlapping parts of the 
English test from the score on the other two parts, the entire English 


score will be eliminated from the total N-4 score in certain statistica 
presentations. 


SAMPLE. The sample used to investi 
includes students at seven V-12 į 
(one in New England, one int 
the Middle West, two in what 


gate the validity of Test С! 
nstitutions: two liberal arts college 
he South), three universities (опе bs 
might be termed the “upper South’): 
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one Midwestern teachers college, and one technical institute. The 
total number of cases studied is 772. Men with incomplete records 
were eliminated from the sample, as were also pre-medical and pre- 
dental students, who followed a first-term curriculum somewhat 
different from that outlined above. Of the total 772 cases, 637 came 
into the V-12 program from civilian life; the remaining 135 were 
enlisted men who came into the program from the Fleet. Since the 
Fleet cases (for practical reasons) were not given the C-l test, it was 
convenient (in this preliminary investigation) to limit most of the 
Statistical treatment to the principal sample of 637 cases. These 637 
cases will be referred to as the “total civilian sample.” 


Validity of the C-test 


CORRELATION BETWEEN C-rzsr AND N-resr. The correlation be- 
tween the total scores on Test C-1 (the college qualifying test) and 
Test N-4 (the comprehensive achievement test), in the total civilian 
sample of 637 cases, is .70. This correlation was also calculated 
Separately for the college containing the largest number of V-12 
students of civilian origin (N = 204); here the correlation between 
scores on the total C-test and the total N-test was found to be .68. 

The two correlation coefficients, .70 and .68, may be considered 
somewhat inflated because of the similarity of two parts of the 
English section of the N-test with the Verbal and Reading sections 
of the C-test. It has therefore seemed advisable to calculate the 
correlation between the C-test and the N-test exclusive of English? 

hese correlations are .64 and .61, respectively. These corrected 
Coefficients are probably somewhat too low, since the elimination 
of the total English section from the N-test, instead of only the two 
overlapping parts of the English section, represents an over-elimina- 

ion. 

The correlations of .64 and .61 apply to the sample of cases who 
Were not only admitted to the V-12 college training program, but 
Were retained at least a full semester in that program. The primary 
Purpose of the C-test, however, is not so much to predict the per- 
formance of students who are admitted to the V-12 program, as to 


discriminate between qualified and unqualified applicants. From 


this point of view, it is reasonable to inquire what the correlation 


fatto where с represents the total 

T, Tes + Tye, 

C-score, and x, y, and z nem. oA ee f the N-test, exclusive of English. 
his formula involves the assumption of equal standard deviations for x, y, and z. For 

pe sample of 637 cases the standard deviations аге, respectively, 2.1, 2.2, and 2.1; and 
Or the sample of 904, 1.9, 2.2, and 2.1. Since no highly precise determination 1s Te- 

quired, these standard deviations may be regarded as virtually equal. 


1 The formula employed is: 
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between C-score and N-score would be in a sample including all 
applicants. The standard deviation of C-scores of the sample of 637 
cases is 13.0 13; of the sample of 204 cases, is 13.1; and of all the 
applicants for the Navy V-12 program (123,206 cases) is 23.1. Cor- 
recting the correlations of .64 and .61 to the values that would pre- 
vail in a sample with а C-score standard deviation of 23.1, we 
obtain !* the values of .83 and .80, which are high enough to indi- 


TABLE 16-х. Detailed correlations between Test C-1 and Test N-41 
(V-12 College Training Program) 


Nares N-4 N-4 мі | ма NA 
слем Math. Physics English History Total 
bs 
53 47 23 24 49 
C-1 Math. 57 52 3l 22 58 
| 32 .60 19 09 42 
Сч Science 38 60 19 | 15 4 
19 16 68 a 51 
C1 Verbal 27 16 64 44 47 
NET 16 28 (M Га 
C-1 Reading 18 17 27 34 31 
42 49 62 44 68 
C1 Total 46 52 62 46 70 


1 The italic figures in the lower-right corner of eac 
687 cases entering V-12 from civilian life; 
single-college group of 204 cases. 


f 
h cell are for the total sample y 
the figures in the upper-left corner are for 


cate a very serviceable degree of relation between C-test (adminis 
tered before admission to 


(administered after a full semester of co 
Table 16-x presents detailed correlati 


for the total civilian sample of 637 
204. None of these correlation coefficients has b 


А Le и а 
15 By way of comparison, a standard deviation of 13.9 on Test C-1 is equivalent fe^ 
iati Examination Board's Verbal Schola 


tion Board's tests is 100. ий 
и Kelley, T. L. Statistical Method, P- 225, formula 186. Macmillan, New York, 
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гасне range." Especially interesting are the correlations in the 
2 ag N-4 Math." and "N-4 Physics.” In the total civilian 
ic rs we C-l Math. section predicts N-4 Math. better than does 
Ha al С-1 test (.57 vs. .46); and the C-l Science section predicts 

Physics better than does the total C-l test (.60 vs. .52). Similar 
results may be observed in the single-college sample of 204 cases. 
E: noteworthy fact is the failure of the Reading subtest, despite 
its superior "face validity," to yield as high a validity-correlation 
= N-4 History as the Verbal part of the C-test. Perhaps the 
emory-factor involved in History achievement is more closely re- 
ated to the Verbal than to the Reading section of the C-test. This 


Fat ed 17-x. Comparison of multiple and simple correlations between 
ividual parts of Test N-4 and sections of Test C-l (V-12 College 
Training Program) 


Sample of 637 Cases Sample of 204 Cases 


Multiple Simple Multiple Simple 
R r R r 


а Math. vs. (С-1 Math., C-1 Science) -60 55 
€ Math. vs. C-1 Math. 57 .53 
-4 Math. vs. C-1 Total 46 42 
E Physics vs. (C-1 Science, C-1 Math.) .68 .66 
oT Physics vs. С-1 Science .60 .60 
-4 Physics vs. C-1 Total .52 49 
47 


N:4 History vs. (С-1 Verbal, С-1 Read.) .48 
Na History vs. C-1 Verbal 44 44 
-4 History vs. C-1 Total 46 44 


Suggests that a reading test which emphasizes delayed memory may 


€ desirable. 
wa has seemed worth while to inquire e с 

ining of separate sections of the C-test, by the technique of multiple 
Correlation, may still further improve the prediction of scores on 
Separate parts of the N-4 achievement test. Table 17-x presents the 

ndings. 
. From Table 17x it appears that a worth-while improvement 
in prediction of N-4 Physics (from .60 to .68, or from .60 
to .66) can be gained by the multiple correlation technique; the 
rrelation coefficients, tending to raise the 
he lower. The differences among the cor- 
great as among the uncorrected, and 
f the present section centers. 


to what extent the com- 


меа а correction would raise all the co 
rected Coefficients in Table 16-x more than t 
it is correlation coefficients would be at least as 

5 chiefly on these differences that the interest © 
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«inex gains in Table 17-х are less impressive or important. In апу 
event, it is clear that the unweighted sum of scores on the separate 
sections of the C-test is not always the most serviceable means for 
predicting achievement in each separate subject. This is true espe- 
cially for Mathematics and Physics. In view of the importance of 
mathematics and physics in the training of most prospective naval 
officers, it appears that scores for the separate parts of the C-test 
might well be taken into account in granting or denying admission 
to applicants to the V-12 Program. 

CORRELATION BETWEEN C-TEST AND AVERAGE COLLEGE GRADE. We 
turn now to the correlation between C-l scores and average grades 
for the first semester of college work. In connection with these data, 
two points must be borne in mind: (1) It is well known that stand- 
ards of grading are not uniform from instructor to instructor, from 
subject to subject, or from school to school. Thus, differences in 
grading-standards among the seven institutions supplying the sample 
of 637 civilian cases are likely to reduce the coefficients for this 
group to a level below that in the single-college group of 204 cases. 
(2) The range of ability in the group retained in the V-12 program 
through the first term is much narrower than in the sample applying 
for admission; and as mentioned previously, the purpose of the 
C-test is principally to discriminate between applicants who are 
qualified and those who are not. A correction for restricted range o! 
ability is therefore applicable. In making this correction, the stand- 
ard deviations of C-scores for the restricted sample were taken from 


Table 19-x. The standard deviations for the applicants are as given 
below: 


C-1 Total Score 23.1 


C-1 Math. 5.5 
C-1 Science 7.1 
C-1 Verbal 11.9 
C-1 Reading 4.8 


The first of the figures just listed (23.1) is based on the total sample 
of 123,206 applicants for the Navy V-12 program; the remaining 
figures are based on a representative sample of 1,500 cases. 

Table 18-x presents the correlation between C-test scores and 
average grade, both for the sample of 637 cases and the single 
college group of 204. Accompanying each original correlation coefh- 
cient is the coefficient corrected for restricted range of ability on the 
C-test. 

In Table 18-x the correlation coefficients for the single-colleg® 
sample of 204 cases are more readily interpretable than those fot 
the sample of 637, since the latter sample is especially likely t° 
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н inter-institutional differences in grading standards. For 
204. In pe the discussion below will be limited to the sample of 
Ss a is sample, the correlation between total score on the C-1 
нана overage college grade is .37; corrected, this becomes .58. 
ни ме атеље of .37 must be considered rather low; the 
ena oa coefficient of .58 is not higher than is sometimes reported 
doe. T sample without any correction. The correlation coeffi- 
пе и : 1e separate parts of the C-test are, as might be expected, 
гака. и ower than for С-1 total score. An exception occurs, how- 
iod a site of the Mathematical section of Cl, for which the 
high correlation with average grade is .38. This is reasonably 
ве Pants bs individual subtest, and is probably explained by the 
coll at Mathematics and Physics figure very heavily in the average 

ege grade (see page 202). It may be noted that the C-l Verbal 


TABLE 18-x. Correlations between С-1 scores and average grade 
(V-12 College Training Program) 


Sample of 637 Cases Sample of 204 Cases 
Raw Corrcla- Raw Correla- 

tion with Corrected tion with Corrected 1 

Test Average Grade Correlation Average Grade Correlation 
C-1 Math. .29 Al 38 55 
C-1 Science 23 30 27 35 
С-1 Verbal 18 .26 21 .29 
C-l Reading 14 26 .20 37 
C-1 Total 31 .50 .37 .58 


1 
Corrected for restricted range of ability in the sample—see text. 


n Reading sections yield lower correlation coefficients than either 
-l Science or Mathematics, and that the Reading section displays 
no special superiority over the Verbal. 

Because of the differences among the correlations for individual 
Sections of the C-l test (see Table 18-x), it was thought that the 
multiple correlation between average grade and the four sections 
Е. С-1 might be appreciably higher than the correlation for С-1 total. 


Se of the multiple correlation technique raises the raw т of .31 for 


C4 Total (in the sample of 637) to 343; and raises the raw т of .37 
(in the sample of 204) to .432. The second rise might be worth the 
üme and expense involved in applying multiple regression weights; 
the former is not. Very likely the most practical recommendation 
Would be simply to increase the Jength (and thus the relative weight) 
Of the Mathematics and Science sections of the C-test. The present 
Reading section of the C-test might be eliminated entirely with little 
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or no apparent effect on the reliability or validity of the total test.! 
If desirable to reduce still further the relative weight of the Verbal 
section, the score on this section might be divided by an appropriate, 
convenient constant (such as 2 or 3), before adding the Verbal score 
to the Mathematics and Science scores of the C-test. 

All the validity correlations in this preliminary study are based 
on men in the initial V-12 input. It will be interesting to observe 
in the later and more complete investigation whether validity 
correlations for later increments, when the V-12 program was pre 
sumably running more smoothly, are any higher. 

SUPPLEMENTARY STATISTICAL DATA. For possible use in the inter- 
pretation of the various findings reported above, means and standard 


ТАВІЕ 19-х. Means and standard deviations of C-test scores, N-test scores, 
and average grades (V-12 College Training Program) 


Sample of 637 Cases Sample of 204 Cases 
Measure M с м с 

С-1 Total 93.7 12.96 91.6 13.07 
C-1 Math. 18.8 3.69 18.1 3.40 
С-1 Science 25.5 5.31 24.0 5.25 
C-1 Verbal 34.2 8.08 34.3 8.42 
C-1 Reading 15.2 2.29 15.2 2.21 
N-4 Total! 5.7 1.92 5.6 1.77 
N-4 Math.! 5.8 2.08 5.5 1.86 
N-4 Physics! 5.6 2.19 5.1 2.18 
N-4 English? 5.8 2.04 5.8 1.98 
N-4 History! 5.9 2.11 6.3 2.06 
Average Grade! 5.0 1.98 4.8 2.07 


1 Original score or grade converted to a scale from 0 through 10. 


deviations of various test and criterion scores are given in Table 
19-x. Intercorrelations between the criteria (N-test scores and aver 
age grades) are given in Table 20-x. 

INTERPRETATION. The chief contribution of this section is tht 
finding that achievement in mathematics and in physics (as measure 
by the N-test) can be better predicted by scores on the Mathematics 
and Science sections of Test С-1 than by the raw score on the tota 
C-1 test. A still better prediction, especially for physics, is possible 
by use of a weighted combination of the Mathematics and Science 
sections of the C-test. These facts imply that the Mathematics an 


У 5 
16In later forms of the Army-Navy College Qualifying Test the Reading section ha: 
been eliminated and the Mathematics section has been increased in length. 
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Science sections of the C-test might well receive special consideration 
when admitting, or denying admission to, candidates for the V-12 
program. With reference to future forms of the Army-Navy College 
Qualifying Test, the implication is that the Mathematics and Science 
portions of the C-test should be allowed to have greater relative 
weight in determining the total test score. These conclusions are in 
line with the current tendency in civilian practice to place increased 


TABLE 20-x. Correlations between criteria: N-test scores and average 
grades (V-12 College Training Program) 


Correlation with Correlation with 
Average Grade, in Average Grade, in 
N-Test Sample of 637 Cases Sample of 204 Cases 
N-4 Math. .50 55 
N-4 Physics 34 89 
N-4 English .28 .29 
N-4 History al .38 
N-4 Total 49 58 


emphasis on aptitude for mathematics and physical science when 

selecting students for engineering curricula. Since, in the Navy, 

Some officers require less engineering aptitude than others, question 

arises whether the scoring and content of the C-test should be revised 

50 as to yield two or three different total scores, each best adapted 

E predict training-success for a major group of officers (e.g., deck. 
Bineering, and supply corps). 


Performance of Enlisted Men Who Entered the V-12 Program 
As mentioned in the introduction to the V-12 study, some men 
entered the V-12 program from enlisted status. Since a different 
Selection procedure was applied for enlisted men, it is of interest 
to compare the V-12 performance of these men with the performance 


9f those entering the V-12 program from civilian life. 
it is desirable to maintain reasonable 


i In making this comparison, it 1s l 
mic елиту in as many factors as possible. In the present study, it 
а been possible to maintain a certain degree of homogeneity with 
espect to the student's home region (northern vs. southern) !*; and, 
$ H By “home region” is meant the geographical area in which the man attended high 
N ool. The following states were included as “southern”: Virginia, West Virginia, 
MLB Carolina, Kentucky, Tennessee, South Carolina, Georgia, Florida, Alabama, 
is ississippi, Louisiana, Arkansas, Oklahoma, Texas, New Mexico, and Arizona. All other 
ates were included as "northern." 
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in one comparison, to maintain, also, identity with respect to the 
V-12 college attended. Table 21-x presents the findings. 

From Table 21-x it is clear that the Fleet-origin cases made N-test 
scores substantially equal to those of the civilian-origin cases; but 
they made better average college grades. In explaining this dis- 
crepancy, two facts appear pertinent. (1) The civilian-origin cases 
were selected, first of all, on the basis of C-test scores, with a second- 
ary screening based on a rating of the high school record and a 
rating for officer-aptitude qualities. The Fleet-origin cases, on the 
other hand, were selected primarily on the basis of job efficiency and 
favorable personal characteristics (such as industriousness, depend- 
ability, fluency, agreeableness, etc.), with a secondary screening on 
intelligence-test score. Since the C-test is more highly correlated with 


TABLE 21-х. Average N-test score and average grade for civilian-origin 
and fleet-origin cases (V-12 College Training Program) 


Average Col- 
Test N-4 lege Grade 
College 
Attended Home Region Origin N M1 ol M1 ot 


x? Northern Civilian 204 56 177 48 2.07 
X Northern Fleet 57 56 240 58 2.21 


Seven 3 Northern Civilian 472 5.8 1.89 50 1.80 
Seven Northern Fleet 107 5.7 2.88 59 2.00 


Seven ^ Southern Civilian 165 5.5 1.98 49 24 
Seven Southern Fleet 98 51 236 58 21! 


1 Original score or grade converted to a scale from 0 through 10. 
? A New England liberal-arts college. 


3 For a description of the seven institutions included in the present study, see pages 
202 and 208. 


N-test scores than is job efficiency or favorable personality charac 
teristics, the civilian cases have an initial selection advantage i? 
respect to N-test scores. On the other hand, the primary selection 9' 
the Fleet-origin cases on such traits as industriousness, dependabi у 
ity, and agreeableness, probably leads to comparatively higher col- 
lege grades than to N-test scores. (2) The civilian cases were, 10 
general, closer to their high school days than the Fleet cases. A? 
already mentioned, the N-test could not reflect local curricula 
peculiarities, but had to restrict itself mainly to the broader, тоте 
essential aspects of each subject. As such, the N-test doubtless reflects 
high school accomplishment to some extent—to an extent greater 
than do college grades, which hinge more closely on performance 
in the particular, local curriculum. Thus it seems likely that the 
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civilian cases enjoyed a relative advantage on the N-test. The greater 
closeness of civilian-origin cases to high school days is an incidental 
factor, of no fundamental significance. Similarly, the probably 
greater personal agreeableness of Fleet-origin cases is also incidental, 
and of no fundamental significance so far as true academic achieve- 
ment is concerned. Whether or not the civilian- and Fleetorigin 
cases are genuinely or basically equal in the abilities tapped by the 
N-test, and whether the two groups are really different in respect of 
the academic abilities underlying college grades, depends on the 
influence of these incidental factors. Unfortunately, the available 
data do not permit a quantitative appraisal of the various factors 
involved. 

From the data on the Fleet- vs. civilian-origin cases it is tempting 
to draw some conclusion regarding the comparative effectiveness of 
the procedures used to select these two groups of cases. But any 
med comparative evaluation requires consideration of questions re- 
Gane to sampling and quotas. Specifically: Was the total number of 
of ~ ит who were qualified for V-12 the same as the total number 
indi €et cases who were qualified (the larger the number of qualified 
of a oe easier the task of selecting capable men)? How many 

ле qualified Fleet individuals were unavailable, in a practical 
Sense, because of active combat duty or distance from shore stations? 
as recruitment (which converts qualified individuals into appli- 
cants) equally effective for civilian and Fleet groups? Was recruit- 
ment more selective (in the sense of attracting a higher proportion 
E Superior applicants) in one group than the other? Was it necessary 
accept lower levels of ability among civilians (in order to meet 


State quotas) than of Fleet applicants (to whom no State quotas 


applied)? These are, at best, difficult questions, to which no answer 
Сап be attempted in this preliminary report. A possible difference 
in the academic motivation of Fleet vs. civilian cases and a possible 
tendency by V-12 instructors to give greater attention to Fleet men 


ar ro a oe ~ 
€ two additional complicating factors. 


Summary 


ent chapter include (1) 


The four main groups studied in the pres | 
27 waves officer-candi- 


63 officers in an indoctrination school; (2) 4 
ates in a women’s reserve midshipmen’s school; (3) 1,342 deck- 
Officer-candidates in a reserve midshipmen’s school; and (4) 772 
pu iis in seven V-12 schools. A brief summary of findings is given 
elow, 


" Inpocrrination ScHooL. 1. The 
fasonably successful in predicting 872 


Officer Qualification Test is 
des in the indoctrination 
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school. This is indicated by a correlation coefficient of about .50 
between total test score and final average grades. 

2. Of the three parts of the Officer Qualification Test, the Arith- 
metical Reasoning subtest is the most successful. Scores on Arith- 
metical Reasoning correlate slightly higher with grades in Naviga- 
tion (.52) than do scores on the total Officer Qualification Test (.50). 
In addition, scores on Arithmetical Reasoning are more highly cor- 
related with final average grade (.46) than scores on either of the 
other two parts of the total test (.36 and .35, respectively). 

3. The validity of the Officer Qualification Test could be im- 
proved somewhat (about .05) by the use of multiple regression 
weights in combining scores from the separate subtests. It is sug- 
gested that the addition of a test or questionnaire relating to per- 
sonality or biographical background might also lead to improved 
prediction of grades in indoctrination school. 

Women’s RESERVE MipsHIPMEN’s SCHOOL. 1. The Officer Qualifi- 
cation Test is only moderately successful in predicting final average 
grades in a women's reserve midshipmen's school (correlations with 
final average grade are slightly under .40). Of the three subtests of 
the Officer Qualification Test, the Arithmetical Reasoning and Op- 
posites subtests predict final average grades more successfully than 
the Mechanical Comprehension subtest (correlations of .34, .29, and 
.20, respectively). Grades in the course on Communications аге pre- 
dicted less well by the Officer Qualification Test (correlation about 
.29) than are grades in the other courses (correlations about .40); 
this is in conformity with other findings of a low relationship be- 
tween general aptitude tests and such functions as the learning of 
radio code and typewriting. 

2. The validity of the Officer Qualification Test could be im- 
proved somewhat (about .05) by use of multiple regression 
weights in combining scores from the separate subtests. It is sug- 
gested that validity could also be improved by substituting a clerical 
ability test for the Mechanical Comprehension test, in the form of 
the Officer Qualification Test administered to waves officer-candi- 
dates. The addition of a test or questionnaire relating to personality 
or biographical background might also prove advantageous. 

RESERVE MipsHIPMEN’s SCHOOL. 1. The final academic average 
in reserve midshipmen’s school (deck) can be predicted best from 
grades during the three-weeks indoctrination period preceding the 
two regular terms of the school (correlation = .80). For those enter- 
ing reserve midshipmen’s school from the V-12 college training 
program, an earlier prediction can be made from scores on the 
N-test (normally administered shortly after the first semester of Ei 
V-12 program); this test yields a validity coefficient of .54. A stil 
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ра Баи is possible by application, to all prospective re- 
Nn. ^u qun of the Officer Classification Test. Scores on the 
EE a y section of this test correlate .49 with final academic 
bs g , A the simple sum of standard scores on the Mathematical 
Sess erbal sections of the test yields a validity coefficient of .52. 
OR 5 on the NROTC Selective Examination (Form C) and the 
cer Qualification Test correlate with final academic average to 
the extent of about .45. 
eer scores from different tests (such as the Officer Classi- 
ча odi est and the NROTC Selective Examination) fails to lead 
bp A cien of practical importance. 
we ~ jan TRAINING Ркоскам. 1. The V-12 study includes а 
en 95 772 students in attendance at seven colleges. The predictive 
T ure investigated is the Army-Navy College Qualifying Test 
(Test Cl). The validity criteria for Test C-l are Test N-4 (a com- 
oe objective test administered a few weeks after the end of 
Eie me semester of the V-12 program), and average college grades 
of T. g the first semester of V-12. Because part of the English section 
val: est N-4 is quite similar to the Verbal part of Cl, the English 
Ned has generally been excluded from Test N-4 in determining 
idity coefficients for Test C-l. 
а 2. In a sample of 637 cases, the correlation between Test С-1 and 
est N-4 (minus the English section) is .64; in a group of 204 cases 
cluded in the 637), the 
for the restricted 


Va, of С-ѕсогеѕ in the sample (a 
wee yields values of 83 a 
to justi nts such as those cited in this [ 
colle fy the use of Test C-l in selecting app 
Ве program. 
Ted The Mathematical section of the C-test, by itself, correlates 
er with N-test scores in Mathematics than does the total C-test 
the correlations are about .55 and 4% respectively). Similarly, the 
re score of the C-test, by itself, correlates higher with N-test 
€s 1n Physics than does the total C-test (the correlations are about 
and .50, respectively. It is clear that the total C-test score, 
i “pam by simply adding scores on the separate sections of the test, 
"sd no means the best available measure for predicting achieve- 
4 Th separate subjects. 
à € use of multiple regressior 


obt 


1 weights in combining scores 


but — а 
Testri he four correlation coefficients cited are all "original coefficients, uncorrected for 
‘ection for restricted range would raise all 


cients more than the lower, and thus 


to increase А 
the indicated differences. 
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from the separate parts of the C-test raises the correlation with 
Physics to about .67 (an increase of -07), but fails to yield gains of 
practical importance for the other parts of the N-test. 

5. The correlation between total C-test scores and average first- 
semester grades is rather low, .37 in the sample of 204 cases. Cor- 
rected for the restricted range of C-test scores in the sample (as com- 
pared with applicants for V-12 training), this becomes .58. 

6. The Reading section of the C-test tends to yield a lower validity 
correlation than the Verbal section. There seems to be no special 
advantage in retaining Reading in the C-test in its present form. 

7. The use of multiple regression weights in combining scores for 
the separate parts of the C-test raises the correlation with average 
grades to a limited extent (between .03 and .06). 

8. A sample of 135 men admitted to V-12 from enlisted status 
Was compared with the sample of 637 admitted from civilian life. 
The enlisted sample made average scores on the N-test equal to 
those of the other sample, but higher average college grades. Some 
possible explanations for this discrepancy are considered. 

9. It is suggested that the C-test might advantageously be supple- 
mented by the Mathematical and Verbal parts of the Officer Classifi- 
cation Test, for the purpose of checking up on borderline or doubt- 
ful cases. 

10. Modification of the C-test should be in the direction of giving 
increased weight to the Mathematics and Science sections of the test. 
A Reading subtest placing emphasis on delayed memory might 
prove more useful than the present Reading section. Consideration 
should be given to a possible revision of the scoring and content 
of the C-test so as to yield two or three different total scores, each 
best adapted to predict training success for a major group of officers 
(e.g., deck, engineering, and supply corps). 

ll. It is emphasized that study of the validity of selection pro 
cedures in the V-12 college training program is still in progress, 50 
that the section of this chapter devoted to the V-12 program is pre- 
liminary in nature. 

The various selection tests yield validity correlations between 
(approximately) .40 and .60, without correction for restricted range 
in the samples studied. Such correlations are high enough to indi- 
cate a useful degree of efficiency; at the same time, such correlations 
are low enough to indicate that either additional tests or other 
selection devices are needed to raise the efficiency of prediction to 
a still higher level. It is suggested that a test or questionnaire Y€ 
lating to personality or biographical background may constitute а 
useful addition. . 

The test of Mechanical Comprehension in the Officer Qualifica- 
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tion Test was found to be of slight value for use with waves officer- 
candidates; the substitution of a clerical ability test may be recom- 
mended. The Reading section of Test С-1 proved, in general, slightly 
inferior to the traditional verbal type of material (such as opposites, 
analogies, and double definitions). There is no apparent advantage 
in retaining the Reading test in its present form. The arithmetical 
reasoning or mathematical aptitude type of test proved especially 
useful in predicting performance both in indoctrination school, in 
reserve midshipmen's school, and in V-12 school. The value of taking 
account of scores on individual tests (as distinguished from total or 
Overall scores only) was made especially clear in the study of V-12 
Students. 

Looking to the future, one may hope, especially, for an extension 
Of criteria beyond course grades to actual performance of practical 
billet duties; to a more comprehensive program of investigation, 
Which will determine the proper place of each selection device or 
Procedure in relation to the others; and to a more ambitious re- 
Search program aiming at deeper and broader theoretical under- 
Standing, without which progress remains at a merely technological 
level. Also needed are simple clear experimental demonstrations, to 
Provide evidence of the superiority of scientific personnel procedures 
Over “common sense” and over practices having no superior sanction 


than use in the past. 


CHAPTER XI 


PREDICTION OF SUCCESS IN 
ADVANCED OFFICER TRAINING PROGRAMS 


As indicated in Chapter IV, it became necessary to supplement 
basic. instruction of naval officers with various types of specialized 
training. Instruction given in primary schools was designed to 
provide a general orientation in naval customs and discipline and 
to acquaint officers with the fundamentals of navigation, seaman- 
ship, ordnance, and similar subjects which are presumably a part of 
the general background of all line officers, Beyond that, advanced 
training was necessary to prepare certain officers for specialized 
billets such as tactical radar, radar specialist, air combat intelligence, 
or diesel engineering, and for duty aboard special types of ships such 
as submarines, motor torpedo boats, and various amphibious craft. 

Selection requirements for each training program were developed 
by the Officer Selection Unit in the Bureau of Naval Personnel, and 
an interviewing program was established in the primary schools to 
funnel officers into programs for which they were best qualified. 
Similar interviewing programs were set up at several of the opera- 
tional training schools where officers were further distributed (0 
specific billets aboard .a given type of ship. At the request of the 
Officer Selection Unit, the Test and Research Section conducted 
research on the prediction of success in advanced officer training pro 
grams. Most of this research was "after the fact” in the sense that 
the Test and Research Section was called in to determine the valid- 
ity of existing procedures rather than to assist in initiating the classi- 
fication program, to study unselected groups, or to carry out a conr 
plete validation study. In this chapter the nature of the validation 
problem, the approach used, the principal findings, and some O 
the implications growing out of the research completed during 
World War II will be described. 


Nature of the Problem 


PURPOSE or RrsrAncH. The research was carried out primarily to 
obtain answers to two broad types of questions: (1) What qualifica- 
tions and attributes are most highly related to success in various 
advanced officer training programs? (2) What are the minimu 
qualifications and attributes required for satisfactory achievement } 


pee se 
such training programs? It was expected that the answers to thé 
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questions would provide the basis for modification of selection re- 
quirements for the advanced training programs. 

, Poputarion. The samples available for study were intact classes 
in advanced officer schools, classes which had been organized fol- 
lowing varying amounts of selection on а priori grounds. Officers in 
these classes had come principally from two sources: (1) reserve mid- 
shipmen’s schools—mostly young men in their early twenties with 
two to four years of college training and little or no civilian work 
experience, and (2) indoctrination schools—mostly men commis 
sioned directly from civilian life with no previous naval experience. 
In addition, there were a few officers from the Naval Academy and 
а number of officers assigned to advanced schools following a tour of 
duty, either ashore or afloat. Officers from the Naval Academy were 
eliminated from most of the studies, however, or treated in separate 
analyses, 

It should be noted that the samples used in these studies were all 
Preselected. Scholastic aptitude, education, and civilian experience 
had, of course, been considered in the original selection of officer 
candidates. In addition, officers were distributed to the various ad- 
vanced schools on the basis of interviewers’ recommendations which 
Were in turn based on aptitude test scores, age, education, civilian 
Occupational experience, record of achievement in basic schools, and 
the duty preference of the candidate (see Chapter П). Consequently, 
Samples of officers in any given advanced school sometimes differed 
markedly from the basic officer population in mean or variance or 
both, on the prediction variables and in the interrelationships be- 
‘ween various prediction variables. 

- The data available on qualifications o been recen 
as Characteristically spotty. No uniform qualifications blank existe! 
10 which research workers could turn for complete and comparable 
Information on each officer, regardless of the advanced school 
Studied. The Officer Qualifications Record Jacket had not been in 


Operati б = : У be 
peration sufficiently long at the time these studies were made to 


of Significant value. Duty Recommendation Forms and Training 


School Reports, developed by the Officer Selection Unit, proved to 
© Of value in the later studies, although even these forms were not 
available in significant numbers until after most of the studies had 
us Completed. Consequently, data had to be obtained froni. non- 
Standardized school records, which contained whatever background 
ata the officers in charge of the particular school in question 
cemed important, or by means of special questionnaires prepared 
9? the research study. 


and ATURE or Арудмсер TRAINING P 
Personnel made it impossible to са 


f officers in advanced schools 


ROGRAMS. Limitations of time 
rry on research for all ad- 
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vanced training programs. An attempt was therefore made to study 
those given highest priority by the Officer Selection Unit on the 
basis of numbers of officers involved and complexity of the predic- 
tion problem. The two general types of training programs following 
primary training schools are described in Chapter IV. 

ADVANCED TRAINING For SPECIFIC Types or Dury. Schools were 
established to provide training for specialized types of duty such as 
tactical radar, radar specialist, air combat intelligence, or fire con- 
trol. Following such training, an officer might be assigned to any one 
of several types of duty stations. For example, a large number of 
officers were sent to communications training, after which they were 
sent to destroyers, amphibious commands, staff duty, advanced bases, 
and various other types of duty stations. Training in this type of 
advanced schools consisted largely of classroom instruction, although 
attempts were made to utilize laboratories, shops, and mock-ups 
simulating operating conditions. 

OPERATIONAL TRAINING FOR Duty ом SPECIFIC Types or SHIPS. 
Operational and precommissioning training courses were developed 
to enroll officers directly out of basic training, or in some cases from 
advanced schools of the type described above, and to train them for 
duty on a specific type of ship, such as a submarine, motor torpedo 
boat, or landing ship, medium (LSM). In some cases such training 
was geared toward a particular billet aboard the specific type of ship: 
as commanding officer or executive officer of an amphibious craft, от 
assistant gunnery officer, communications assistant, or assistant пау!“ 
gator on a destroyer. For certain highly specialized craft, particularly 
submarines and motor torpedo boats, a general training for all- 
round duty on that type of ship was given. Operational training 
usually involved a relatively short period of classroom orientation 
and instruction, often given in a brief introductory portion of the 
total training course, while considerable emphasis was placed on d 
practical application of knowledges and skills in operational trainin 
aboard ship. 

DIFFERENTIATION WITHIN ADVANCED TRAINING AND OPERATIONA Wd 
TRAINING. Within each of these two broad types of advanced train 
ing programs, a further differentiation can be made on the basis 9 
the degree of technical knowledge (knowledge of mathematic 
physics, engineering) required for successful completion of the m 
ing course. The curricula of all the schools include certain elemen Я 
of a technical nature, and strictly speaking, the schools should 
placed on a continuum in this respect since they vary in degree en 
technicality. It may be helpful, however, to distinguish hee 
highly technical and semi-technical training programs in each of p 
two main categories. Hence, the types of training programs may 
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outlined as follows, with the specific programs studied by the Test 
and Research Section listed under broadly descriptive headings. 


1. Specialized training schools for specific types of duty: 


a. Highly technical—pre-radar, engineering, advanced fire con- · 
trol, advanced ordnance and gunnery. 

b. Semi-technical—tactical radar, fighter director, air naviga- 
tion, air combat intelligence, communications. 


2. Operational training for duty on specific types of ships: 


a. Highly technical—submarines, destroyers. 
b. Semi-technical—attack transports, minesweepers, landing 


ships, medium, motor torpedo boats. 


. CRITERION MEASURES oF SUCCESS IN ‘TRAINING. The criteria used 
in these studies will be evaluated in later sections of this chapter; 
here they will simply be described. In general, three different kinds 
of end-of-course estimates of achievement were used as criteria: 
(1) training course grades assigned by instructors, (2) ratings by super- 
Vising officers, and (3) achievement test scores. In some instances 
More than one type of criterion was used in a single study. Quite 
frequently rank in class was the index of success actually used, but 
this in turn was based on one or more of the above-mentioned 
Measures. For the most part, the criteria used in these studies were 
simply the criteria used by the schools themselves in evaluating the 
achievement of their officer students. Little effort was made by the 
representatives of the Test and Research Section, except in the case 
of the studies at Naval Training School (Tactical Radar), to develop 
Criteria other than those used by the schools themselves. Each of 
the three types of criteria referred to above is described briefly in 


turn, 
Course Grades. Navy training programs customarily assigned daily 
instructional program. These 


а Weekly grades on each aspect of the i 
Brades were usually based on officers’ performance on nonstand- 
ardized, usually non-objective, tests (prepared and administered by 
Instructors and covering the course content assigned for the im- 
mediately preceding period). Sometimes the grades included marks 
9n notebooks or other exhibits prepared in accordance with in- 
"TUctors' directions; and sometimes they were based on instructors' 
ratings of performance on equipment, as in the combat information 
center mock-up, or the attack teacher at the submarine school. 
Grades assigned in specific courses Were averaged, with varying sys- 


t = H 1 “ =; за 
паре of weighting particular courses, (0 obtain the “academic aver 


age," 5 : aget - tade 
5e.” This average, sometimes in combination with officer aptitu 
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ratings, constituted the final grade which determined an officer's 
standing in his class. In the Test and Research Section studies, the 
composite academic grade was usually used, although in some cases 
grades in specific courses were used as partial criteria. Ll 

Ratings by Supervising Officers. Ratings by supervising officers 
were characteristically used for two purposes: . 

l. to assess those qualities of leadership, work-habits, and military 
bearing generally subsumed under the heading of “officer aptitude", 
and 


2. to evaluate quality of performance afloat (both under instruc- 
tion and during shakedown). 

Relatively simple rating forms were generally provided, patterned 
somewhat after the Officer Fitness Report; and supervising officers 
were required to indicate whether a given officer was unsatisfactory, 
average, good, or outstanding on the points in question. Seldom was 
the rating analytical, designed to provide internal checks, or accom- 
panied by more than the simplest effort to train raters in the use of 
the rating instruments. The raters usually had reasonably good op- 
portunity to observe the performance of the officers they rated, but 
they were not provided with adequate standards of evaluation nor 
with satisfactory instructions for systematic sampling of students 
performance. 

Achievement Test Scores. Only in the tactical radar 
studies were standardized objective final achievement 
developed. Scores on such examination 
criteria and were also combined with ot 
determination of final average grade. 


and pre-radar 
examinations 
5 were used as independent 
her grades and ratings in the 


Methods of Analysis and Their Limitations 


The analyses were primarily correlational; 
cients of correlation were utilized to estimat 
tween predictors and criteria of success. In 
variance was used where the predictive cat 
continuum, as in the case of major field in ¢ 
pational or age groups. Predictors were cor 
in school defined on an all-or-none basis as “pass” or “fail” and 
(2) with success as defined in terms of degree of achievement of the 
passing students, disregarding failing students or placing them 1n 
the lowest category of success. 

It is important in interpreting the results presented in the next 
portion of this chapter to be cognizant of the numerous limitations 
of these analyses. One of the principal outcomes of this phase of the 
research program may be that of sensitizing those responsible fot 


various types of coeffi- 
e the relationship be- 
some cases analysis of 
egories were not on à 
ollege, or civilian occu- 
related (1) with success 
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research to the obstacles which must ђе overcome before results 
meriting a high degree of confidence can reasonably be expected. 
Consequently, the following limitations, mentioned incidentally in 
preceding paragraphs, are listed and described below. 

PRESELECTION OF TRAINEES. As in almost all validation research 
conducted by the Test and Research Section, trainees whose qualifi- 
cations and performance were studied had already been selected, to 
varying, and largely unknown, degrees, on certain of the variables 
whose predictive value was the object of study. Never was a random 
sample or a sample representative of the entire basic officer school 
population sent to a school as part of an experimental procedure to 
determine what qualifications were most highly related to success 
Mm that training program. Candidates were selected on the basis of 
multiple criteria, with interviewers applying varying standards to 
meet immediate quota demands. In addition, certain factors not 
under investigation, such as degree of motivation of the officer being 
classified, were allowed to operate in the selection of the samples, 
but the extent of their influence was not measured or controlled. 
Such preselection complicates greatly the problem of interpreting 
results so as to infer what relationships between predictive variables 
and criteria would hold for an unselected population. . А 

LIMITED NATURE oF PREDICTIVE DATA. Certain predictive vari- 
ables can scarcely be said to have been thoroughly evaluated; data 
on civilian occupational experience, for example, was very scanty 
(limited only to the general title of an officer’s civilian occupation, 
as engineer, foreman, salesman, or production inspector, with no 
Indication of the specific type of work done, number of employees 


Supervised, salary, or any other index of level of skill or degree of 


responsibility). Findings regarding the predictive value of civilian 
Occupational experience must therefore be considered as merely in- 
dicative of what might be expected had more refined measures been 
used, 

Furthermore, a number of plausible hypotheses were never sub- 
mitted to experimental test. Pressure for immediate results and 
limitations in numbers of competent personnel available for re- 
Search work prevented study of many promising leads. For example, 


NO measures of interest were used systematically and evaluated scien- 


tifically. Officers in basic schools were asked to express their prefer- 
ence for duty. But these expressions were biased by suggestions from 
Interviewing officers, based partially on their knowledge of billet 
quotas at the time the advice was given. Evaluation of officers by 
their fellow officers, self-evaluations, and use of biographical inven- 
tories are other possible predictors not subjected to thorough 


Investigation, 
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INADEQUACY oF CRITERIA. As indicated above, the criterion used 
was ordinarily the composite of grades and ratings, or the class rank 
derived therefrom, used by the school as its index of achievement. 
These indices were by definition the sole measures of success as long 
as attention was directed exclusively to selection for existing schools. 
Nevertheless, they are subject to the following criticisms as criteria 
on the basis of which to generalize concerning the predictive value 
of various qualifications data. 


1. No systematic study was made of the validity of the objectives and 
course content of the schools, in terms of their relationship to the actual 
Operational job to be performed. A preliminary study was begun in 
which success in school was to be checked against success in duty at sea, 
but the war ended before the validation study could be carried out. 

2. Aside from the question of validity of the schools’ objectives and 
content, the validity of grades and ratings on specific aspects of many 
of the training Programs was open to serious question. Grades and rat- 
ings were largely subjective; instructors’ biases and prejudices, as well 
as chance error, undoubtedly entered into the evaluations in varying 
degrees. Moreover, they were not known to be comparable from school 
to school nor from class to class in a given school—making inter-class 
comparisons and the pooling of data from several classes precarious. 

3. The problem of prediction was further complicated by the schools’ 
use of composite criteria of success, often composed of disparate elements. 


as criteria; but freque 


analyses and unwillingness of school officers to question their evalua- 
tion techniques thwarted such efforts. In the early stages of its work, 
the Test and Research 
serious limitations of the criteria commonly in use; but as the evi- 
dence accumulated, the officers engaged in research came to recog- 
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nize that the establishment of satisfactory criteria was the major 
problem, to be given precedence over further refinement of pre- 
dictors, more elaborate statistical techniques, and other means of im- 
Proving the validation studies. 

Lest the foregoing account leave the impression that the studies 
were valueless, it should be pointed out that not all these criticisms 
apply to every advanced training program and that efforts were 
made to select predictors and criteria at any given school so as to 
minimize these limitations. Some proposed studies, such as the LST 
(landing ship, tank) and armed guard programs, were dropped be- 
cause of the practical impossibility of securing reasonably adequate 
criteria. At the same time, it must be admitted that only in the 
tactical radar and pre-radar studies was a real effort made to develop 
an acceptable criterion; and in that fact lies the greatest weakness 
of the studies on the prediction of success in advanced training 


Programs for officers. 
Findings 


Correlation coefficients! between success in training and certain 
aptitude tests are shown in Table 1-х1. Means and standard devia- 
tions for these tests are given in Table 2-x1. For most of the schools, 
the criterion of success in training was final school grades. In a few 
у indicated by footnotes to the table, performance ratings were 
used, 


Prediction of Success in Training for Specific Types of Duty 


Hicury Trcunicau Scuoors. Although it is difficult to generalize 
Оп the basis of data from studies which are not strictly comparable, 
the following statements seem warranted from an analysis of valida- 
tion studies in five advanced officer schools with highly technical 


Curricula. (Table 1-x1, Part I.) 


1. Success in advanced officer schools with highly technical curricula 
Сап be predicted reasonably well by use of the Mechanical and Mathe- 
matical Sections of the Officer Classification Test. (In order to interpret 
this statement properly, it should be noted that, except in the case of the 
air Navigation and pre-radar programs, no predictive variables other than 
Scores on the Officer Classification Test were investigated.) | 

2. There is some evidence that for such a highly technical course as 
Ртетадаг, a test of achievement in a specialized field of knowledge (in 


this case a General Physics Test) may surpass the Officer Classification 
€st in effectiveness of prediction. The obtained correlation coefficient 
between scores on the General Physics Test and success in pre-radar train- 


i Analyses of a non-correlational character are not presented in tabular form. 
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ing was .54 for a sample of 120 officers. In this case the sum of scores on 
the General: Physics and General Mathematics Tests correlated .60 with 
school success. . 

3. There is very little differentiation among these highly technical 
schools with respect to the sections of the Officer Classification Test 
which are most predictive. Superior performance on the Mechanical and 
Mathematical Sections appears to be necessary for success in practically 
all these schools. Special tests designed for prediction in each specific 
school might differentiate between them; the Officer Classification Test 
does not. 


SEMI-TECHNICAL SCHOOLS. As indicated earlier, certain of the ad- 
vanced schools require a lesser degree of skill and understanding in 
mathematics and the physical sciences than those listed as highly 
technical. The courses in the semi-technical schools involve two 
main elements: first, knowledge of the rudiments of navigation, with 
major emphasis on plotting; and second, rapid mastery of a large 
body of procedural doctrine, including terminology peculiar to the 
particular billet. This description certainly applies to the tactical 
radar, fighter director, and air combat intelligence billets, and at 
least the second aspect applies to communications training. (See Part 
П, of Table l-xr) Studies of these programs reveal a less definite 
pattern than studies of the more highly technical courses, but the 


following observations seem justified on the basis of the research 10 
this area. 


І. Success in the semi-technical advanced officer schools can be рг 
dicted reasonably well by using the Verbal and Mathematical Sections 
of the Officer Classification Test. For a sample of 83 officers in three 
classes at the Tactical Radar School, final grades correlated approx! 
mately .32 with the Verbal Section and .49 with the Mathematical Sec 
tion of the Officer Classification Test. The study of officers in Air Combat 
Intelligence School provided evidence of a negatively accelerated поп: 
linear relationship between success in that school and scores on the Verba 
Section of the test. It also yielded 7'5 of .42 and .52 between school grades 
and the Mathematical and Spatial Sections, respectively. 

2. Special aptitude tests were developed which will predict school 
success reasonably well, but not appreciably better than selected parts 
of the Officer Classification Test. The CIC Aptitude Test yielded corre 
lation coefficients of .54 with school success at N'TSch (Tactical Radar), а 
figure comparable to that of the Mathematical Section of the Officer 
Classification Test. For a sample of 70 cases, application of the Wherry- 
Doolittle procedure yielded a multiple correlation coefficient of .58 Whe" 
scores on all four sections of the Officer Classification Test and on the 
CIC Aptitude Test were combined. Although the sample was not ade- 
quate to make the foregoing analysis definitive, it tends to indicate t в 
for a semi-technical school of this type, a standardized battery of ар о 
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tude tests for officers will probably yield results about as satisfactory as 
specialized aptitude tests designed to predict success in specific schools. 

3. Previous training in science and mathematics seems to be desirable, 
although differences in favor of the officers so trained as compared to 
officers with non-technical training were not very large. Officers with 
scientific training (including the fields of engineering, physics, chemistry, 
and mathematics) made a mean final grade of 3.16 in the Tactical Radar 
School, while officers with non-scientific training (in any field other than 
those listed above) made a mean score of 3.08. The difference of .08 is 
approximately .4 of the standard deviation of either distribution. This 
difference was statistically significant but not large enough to be of much 
practical significance. 

4. Age and civilian occupational experience appear to be of little 
predictive value in these schools. At the Tactical Radar School the 
younger officers made somewhat higher final grades than the older men, 
although between the ages of 22 and 30 the differences were very slight. 
Over 30, there appeared to be a definite reduction in mean final grade. 
No men under 22 were included in the study. Similar results were ob- 
tained in the Air Navigation School. In the Aviation Engineering School 
the older men had more training and experience than the younger men, 
hence a significant positive correlation was obtained (.24). 


The following additional comments should be made concerning 
the researches conducted in semi-technical schools. 


1. The Officer Personal Inventory and portions of the Biographical- 

reference Inventory were tried out in two studies at semi-technical 
schools (Tactical Radar and Air Combat Intelligence) and were found 
to be of very little predictive value. The evidence is much too meager, 
however, to support a generalization regarding the potential usefulness 
of instruments of this type. я 8 и 

2. The aviation engineering training program provided an interesting 
Verification of the general patterns described above. It appeared to call 
for a combination of the abilities necessary for the highly technical and 
semi-technical programs. The final grade was based on (1) performance 
in engineering classroom and shop work, and (2) performance in classes 
designed to train the officers for administrative work, with about equal 
Nominal weight given to the engineering and administrative aspects of 
the course. In line with this analysis of course content, success in this 
School was best predicted by the Verbal and the Mechanical Sections of 
the Officer Classification Test (75 of -33 for each part). The group varied 
in amount of schooling from 10 to 18 years. Since years of schooling 
Correlated .35 with average grades, a minimum requirement of at least 
one year of college seemed justified. 


3. The correlations of the Mechanical and Mathematical Sections of 


the Officer Classification Test with success in Communications School 
are of some interest. These officers were assigned to this type of ed 
In part because of their above average verbal ability. But among olicers 


228 Prediction of Success 


of this level of verbal ability, those with high mechanical and mathe- 
matical scores surpassed those with low scores in these tests. Thus, iit 
appears that fairly high scores on the Mechanical and Mathematical 
Sections of the test may be a reasonable requirement of a secondary 
nature for those officers who are assigned to Communications School. 


The substance of the foregoing discussion is to place a good deal 
of stress on the importance of mechanical and mathematical ability 
in the officer population, not for just a few schools but for the 
majority of the training programs. Thus, it would seem justifiable 
in the future to establish procurement policies to attract a large pro- 
portion of officer candidates with mechanical and mathematical 
ability superior to the average of the officer population of World 
War II. There will apparently still be some value in distributing 
these officers among the various advanced schools in accordance with 
their particular patterns of abilities, but since so many schools ap- 
parently require fundamentally the same kinds of ability (particu- 
larly mathematical ability) and in approximately the same degree, 


it is highly important that the officer population include men well 
qualified in these respects. 


Prediction of Success in Operational Training Programs: 


The data for the Operational training programs are presented in 
Part III of Table 1-x1, 

HicHLY TECHNICAL TRAINING. The degree of technicality in- 
volved in the operational training program is directly a function O 
the complexity of the type of ship for which men are being prepared 
in the program. The submarine is a highly complex mechanism and 
the training program for submarines is correspondingly technical. 
Likewise, the training program for destroyer officers called for 
mastery of more technical material than did the corresponding train- 
ing for amphibious craft and motor torpedo boats. 

The following generalizations regarding the relatively technical 
operational training programs are based on studies of only these two 
programs. The sampling in each was fairly extensive, however, an 
in the case of the destroyer program at least, the criterion was ре! 
haps the best available in any operational training program studied. 

Success in the highly technical operational training program can 
be predicted fairly well on the basis of total Officer Classificatio? 
Test scores with the Mathematics and Spatial parts of the test соп" 
tributing most in predictive efficiency. Prediction is not as high 
however, as in the advanced officer Schools previously described. Ip 
a sample of 293 submarine officers, total scores on the Officer Class" 
fication Test correlated .40 with final class rank; the Mathematica 
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Section yielded a correlation of .34. Correlations with the pass-fail 
criterion were somewhat higher. At the destroyer school the Mathe- 
matical Section correlated .36 and the Spatial Section correlated .38 
with the overall criterion. 

Non-linear relationships between aptitude test scores and school 
success were found in the case of the destroyer officers, indicating 
negatively accelerated relationships, as in the case of the air combat 
intelligence group. The total Officer Classification Test scores 
yielded an r of .46 and an eta (final ratings on test scores) of .55. 

Little relationship was found between age and school success. At 

the destroyer program, for example, a low non-linear relationship 
Was observed between age and school success, with officers outside 
the preferred age range of 25 to 32 rated higher than those within 
the preferred age range. 
. Again in the case of the destroyers, mathematics-science-engineer- 
ing training was found to be somewhat desirable, but civilian occu- 
pation apparently bore little relationship to success at the school. 
Officers with mathematics, science, and engineering training were 
found to be significantly superior to those whose college major came 
from the fields of literature, language, and social studies. 

RE@ATIVELY NON-TECHNICAL TRAINING. This classification іп- 
cludes the programs for training LSM and motor torpedo boat 
officers, The outstanding characteristic of these programs which 
differentiates them from those previously described is the emphasis 
9n practical afloat training and the handling of enlisted personnel. 
In each case, classes were held and grades assigned for classroom 
Work, but there were practically no failures on academic grounds 
апа the principal emphasis throughout was placed on the afloat 
training, 
a more significant index of 


Civilian experience appears to be : in 
1 operational training pro- 


Probability of success in the non-technica l i 
Srams than in the more technical schools. Managerial experience 
ànd experience with the handling of small boats were found to be 
definitely important factors in the selection of motor torpedo boat 
Officers, Among LSM officers a difference was found in favor of those 
with mechanical experience, although the relationship was not 
Statistically significant with the relatively small sample studied. 
The Officer Classification Test was found to be of relatively little 
value in predicting success in these programs. Studies of motor tor- 
редо boat officers showed almost по relationship between Officer 
Classification Test scores and final test grades, although moderately 
high relationships were found for specific courses in the introductory 
theory part of the training program (Table Та). Among the LSM 
officers, the Verbal and Mechanical Sections of the Officer Classifi- 
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cation Test correlated .22 and .20 respectively with afloat ratings on 
the officer training courses (it should be noted also that these tests 
correlated .32 and .29 respectively with average grades in the class- 
room instruction phase of the LSM program). 

Over a wide range from approximately 18 to 35 years, age was 
found to have very little relationship to success in these training 
programs. An exception to the above statement should be indicated 
in the case of a group of motor torpedo boat officers given ratings on 
the quality of their performance in combat; in this case the older 
men were rated somewhat superior to the younger, largely because 
of their ability to handle the administrative tasks involved in leader- 
ship of squadrons and larger units in motor torpedo boat warfare. 


Summary 


A dual summary will be presented. First, the principal findings 
of the research program will be summarized in terms of the type of 
training program, indicating the factor or factors which have been 
found to be most highly predictive of success in each type of training 
program. Secondly, consideration will be given to each type of рге- 
dictive variable and an attempt made to indicate the kinds of ad- 


found to have predictive value. It should be recognized that generali- 
zation with respect to the efficacy of various predictive variables 15 
necessarily limited by the fact that relatively few different kinds of 
predictors were used in the research program. 

ADVANCED ScHoors. Aptitude test scores were found to be more 
predictive of success in advanced schools than age, education, civil- 
ian experience, and the other predictors studied. For all the ad- 
vanced schools, the Mathematical Section of the Officer Classification 
Test was fairly predictive of success (75 with school grades in the 
neighborhood of .50). In schools Whose curricula involved rapid 
learning of a large amount of procedural doctrine, the Verbal Sec 
tion of the test also proved to be usefully predictive; but in the more 
strictly technical schools, the Mechanical Section was best used in 
conjunction with the Mathematical Section. With the possible ex- 
ception of such highly technical schools as Pre-Radar (or schools such 
as the Sonar School, requiring exceptional sensory ability), it ар“ 
pears that a standardized battery of aptitude tests comparable to the 
Officer Classification Test will yield as satisfactory results in pre- 
dicting school success as will more highly specialized aptitude tests 
designed specifically for predicting success in specific schools. 

Operational Training Programs. In the more technical of the oper 
ational training programs, total score on the Officer Classificatio™ 
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Test proved to be more predictive than any other variables investi- 
gated (r's of approximately .45 with final grades in the training pro- 
grams), although college training in science and mathematics was 
also related to success. In the non-technical operational training pro- 
grams, the test scores proved to be of very little predictive value, 
Whereas civilian occupational experience was found to be of con- 
siderable significance. Particularly in a specialized but non-technical 
program, such as the training of motor torpedo boat officers, mana- 
gerial experience in civilian life proved to be related to ratings on 
performance afloat, both under instruction and in combat. In gen- 
eral, it appears that as one goes from the more technical to the less 
technical programs, the predictive value of aptitude test scores de- 
creases and the significance of civilian training and occupational 
experience increases. 

Summary or FINDINGS BY PREDICTIVE VARIABLE. In interpreting 
the following summary, it should be remembered that the conclu- 
sions are based on conditions operative during World War II. If 
the basic officer population were selected in a significantly different 
manner or if the curricula and grading policies of the schools were 
changed considerably, these generalizations might not be applicable. 
В Аре. Тһе age variable was investigated in almost all of the train- 
Ing programs and proved to be of little importance for predicting 
success in most of the officer programs. It may well be that maturity 
is a significant factor, as is claimed by a large portion of school 
officers. If so, age is apparently an unreliable measure of maturity. 

Education. Amount of civilian education, as measured by the 
number of years spent in school, is not ordinarily important among 
а group of officers all of whom have had some college training. But 
lit may be significant if a wider range of education is represented, 
as in some of the special aviation training programs where some of 
the enrollees had less than college training, while others had done 
graduate work. Type of education, as indicated by major field of 
of study in college, was found to have some predictive value for 
advanced schools and for the more technical of the operational 
training programs. 

Civilian Олноа Experience. Although in almost all schools 
officers with experience in mechanical and engineering occupations 
Proved to be slightly more successful than officers who had done 
non-technical work in clerical and sales occupations, this factor was 


Senerally of less predictive value than the aptitude tests. In the 


relatively non-technical operational training programs, however, 
cceptance of administrative 


where handling of enlisted men and ассер ә a 
responsibility overshadow mastery of technical subject-matter, civil- 
làn occupational experience of an engineering or managerial type 
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apparently bears more relationship to success in the training pro- 
gram than does proficiency on standardized aptitude tests. . 

Aptitude Test Scores. 1. General aptitude tests. The Officer Glass 
fication Test proved to be reasonably predictive in all except the 
non-technical operational training programs. The type of program 
in which each section of the test was most predictive is indicated 
below: - 

Verbal—to a moderate degree in all the advanced training pro- 
grams; highest average scores were made by officers in the semi- 
technical advanced schools. 

Mechanical—the highly technical schools such as pre-radar, ord- 
nance, and gunnery, advanced fire control, and diesel engineering. 

Mathematical—all the advanced schools, and the operational 
training programs, with the exception of LSM afloat training. 
Mathematical ability is apparently the basic ability most in demand 
in advanced training of naval officers. 

Spatial—Air combat intelligence in the semi-technical advanced 
school group and the highly technical operational training programs 
(notably the destroyer and submarine programs). . 

2. Special aptitude tests. Tests of special aptitude proved to be ol 
some value for prediction in the advanced officer schools, but they 
were only slightly more effective than the various parts of the Officer 
Classification Test. 

Other Data. The scores on the Officer Personal Inventory were 
found to bear little relationship to school success; but it should be 
noted that in the instances where the Personal Inventory wis 
studied (submarines, destroyers, tactical radar), the officers were 50 
cases with high Personal 
iographical-Preference In- 
in basic training, interest 
n by peers, so little ev 
at all) that no generaliza- 


ventory, duty preference statement, grades 
inventories, self-evaluation, and evaluatio: 
dence was obtained (in some cases none 
tions are warranted. 


€asures in the prediction of success in 
e а 5 mes 
training and on the job. By studying these factors and by making 


systematic coordinated studies in place of the piecemeal studies coat 
ried out during the war, the efficiency of prediction in advance‘ 
officer training programs should be considerably improved. 


CHAPTER XII 


PREDICTION OF SUCCESS IN ELEMENTARY SCHOOLS 
FOR ENLISTED PERSONNEL 


Yur selection of qualified trainees for enlisted elementary schools 
constituted one of the Navy's major personnel problems during 
World War II. As new schools were established, selection require- 
ments had to be formulated for the guidance of the classification 
officers who were responsible for making school assignments; and 
revisions in these requirements had to be made as dictated by ex- 
perience and Navy needs. The studies reported in this chapter are 
concerned with (1) determining the relationship between certain 
data on the Enlisted Personnel Qualifications Card and grades re 
Ceived in schools, and (2) establishment of the most suitable cutting 
Scores on tests and minimum standards of personal requirements for 
different types of elementary schools. 

Before the introduction of the Basic Test Battery in June 1943, 
the problem of the utilization of test scores in formulating selection 
requirements for elementary enlisted schools had been approached 
by Studying the relationship between scores on the old Navy test 
battery and school grades. Selection requirements involving the new 
Basic Test Battery were tentatively established on the basis of cor- 
relation coefficients computed between the tests previously in use 
and those newly adopted. In the determination of selection criteria 
for some of the schools, the new tests were administered experi- 
mentally to classes just beginning their instruction in the school and 
also to classes ready for graduation. Tests which showed the best 
Predictive powers were selected for incorporation into the selection 
requirements, and cutting scores on the tests were set. Since recruits 
with low scores on the selected tests appeared to have little chance 
of completing successfully a school course, they were not to be 
recommended. The main factors basic to the determination of the 
evel of the cutting scores were the difficulty of the school curricu- 
um and the quota of personnel to be assigned to the school. 

From the data gathered upon recruits assigned before the new 
tests were in use and from data on those assigned on the basis of 
tentative selection requirements involving the new test battery, it 
Was possible tentatively to determine the effectiveness of the new 
Selection criteria, A more comprehensive evaluation, however, 
awaited the gathering of data on large numbers of recruits who 
Were assigned to shoals with Basic Test Battery scores as part of 


the information available at the time of assignment. 
233 
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The Populations Studied 


The school groups used in the analyses to be presented were 
tested with either Form 1 of the basic battery tests in 1943 or with 
Form 2 in 1944. Data on trends, which have been presented in 
Chapter VI, indicate that the time of the year in which school D 
signments are made constituted one of the significant factors in ie 
determination of the type of personnel assigned to school; a secon 
important factor was the changes in school quotas. The te 
taking Form 1 of the battery were tested between June 1943 an - 
January 1944 with approximately the same number of trainees per 
month. A large proportion of the subjects who were given Form 2 
of the battery were tested in the months of June and July when the 


mean monthly scores on the tests were among the highest for the 
year. 


In the assignment of 
training centers, test 
formation which is u 


personnel by classification interviewers at the 
Scores have constituted only a part of the in 


» (b) previous experience, (c) interen, 
fication interviewer. Th 


; several school locations also were z 
resented for each type. One factor in the selection of classes wa 


that of securing a sufficiently large population in the class to lend 
stability to the statistics obtained. 


Validity data will be presented for the schools listed below. The 
abbreviati i 


mates and are here designated HC. 


Aviation Machinist's Mates 


AMM 
Aviation Ordnancemen AOM 
Aviation Radiomen ARM 
Basic Engineering B. Eng. 
Diesel MoMM 
Electrical EM 
Fire Controlmen FC 
Fire Controlmen (O) ЕС (0) 
Gunner's Mates 
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Hospital Corps HC 
Hospital Corps (WR) HC (WR) 
Machinist’s Mates MM 
Quartermasters QM 
Radio RM 
Radar Operators RdM 
Signal SM 
Storekeepers SK 
Storekeepers (WR) SK (WR) 
Torpedomen TM 
Yeomen Y 
Yeomen (WR) Y (WR) 


Predictive Factors 


The principal selection factors studied include scores on six gen- 
eral tests of the Basic Test Battery and three special tests of the 
battery, a quality classification assigned to each man by the classiti- 
cation interviewer, age, and amount of civilian education. 'The gen- 
eral tests, together with the appropriate abbreviations are: 


General Classification Test GCT 
Reading Test D 
Arithmetical Reasoning Test ARI 
Mechanical Aptitude Test . MAT 
Mechanical Knowledge Test (Mechanical Score) MKM 
Mechanical Knowledge Test (Electrical Score) MKE 
The Special tests are: 
Spelling Test D 
Clerical Aptitude Test oe 
Radio Code Test—Speed of Response 


A description of the first eight of these tests has been given in Chap- 
ter VI. The Radio Code Test has been described in Chapter VIII. 
hile statistical data on Forms 1 and 2 of the six general tests 
Will be presented, data for the other three are available for Form 
1 alone. The classes of the schools for which data on the special tests 
are presented are identical with those used in the analyses of Form 
of the six general tests. This is because the special tests did not 
€come a part of the testing program at the naval training centers 
until January 1944, at which time Form 2 of the general tests was 
Introduced. Р 
The “quality classification” constitutes a recommendation by the 
interviewer relative to the recruit’s qualification for the school for 
Which he is recommended. Quality "1" indicates exceptional back- 
8round qualifications for a particular school assignment although 
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: : — ality 79" indi- 
not necessarily characterized by high test scores: quality "2 ig 
cates high scores and no unique occupational background; and "d 
^ = MORTE. ay 
indicates that the man has only limited school possibilities. ] a 
not assigned a quality classification were recommended for genera 
detail.” | | — 
The statements made by the recruit relative to his age and "E 
alificati ard were 
school grade completed as recorded on the Qualifications Ca 
used. 


Criterion 


ae z А :nal school 
The criterion of achievement in all cases was the final sc € 
. тей 
grade assigned to the trainee, by whatever process the school arrive 
at it. At the time Form 1 was 


administered, these grades were de- 
termined from marks on Written tests constructed in the various 
schools and marks assigned in laboratory or practical courses. Stand- 
ardized achievement examinations, both written and performance. 
were in use in some of the schools for which Form 2 data are re 
ported. When they were used, they were to be given a crude besos 
of approximately one-third in making up the final grade. Standar Е 
ized written achievement examinations and performance tests were 
used in the gunner's mate 


H al 
· radar operator (some schools), signa í 
torpedoman, and yeoman schools. Standardized written achievemen 


examinations but not standardized performance tests were used = 
fire controlman, storekeeper, and electrical schools. No standardizec 
written or performance tests were used in the aviation machinist 5 
mate, aviation ordnanceman, aviation radioman, fire controlman 
(O), hospital Corps, quartermaster, and radio schools. 1 

The exact nature of the criterion varied from school type to schoo 
type, from location to location, and from class to class. Efforts were 
exerted to raise the reliability of the School grades and to increase 
their relationship to the actual jobs the graduates were expected ши 
perform, so that the criterion data for the later classes, the classes 


which had been tested on Form 2 of the Basic Test Battery, 216 
probably more reliable and more valid. 


Statistical Procedures 


3 е or 
As stated earlier, the tests of the Basic Test Battery were used f 
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selection purposes before validation studies could be made. For each 
type of school the test or tests were specified and cutting scores set 
on the basis of previous general experience and rational considera- 
tions. For this reason, the graduates of a type of school were more 
homogeneous with regard to test scores than was the general recruit 
population from which selection was made. The effect of this restric- 
tion in range of test scores was to lower the validity coefficients. In 
general, the decreased variability was most pronounced in the most 

plausible” test for a given school, so that the test which was pre- 
sumably the best might be made to appear among the worst. To 
facilitate comparison of validity coefficients, Kelley's formula * for 
correction for restriction in range was used. This formula makes 
Possible an estimate of what the validity coefficient would have been 
if the general recruit population had been sent to the school rather 
than the actual restricted sample. The estimated or corrected соећ- 
cients (r.) were, in practice, obtained from a table constructed to 
represent Kelley’s formula (Appendix Е-4). 

The formula assumes (1) that the restriction in the criterion is 
Produced entirely by selection on the given test, (2) that the regres- 
sion of the criterion on the test is rectilinear, and (3) that the chart 
representing the correlation between the test and the criterion is 
homoscedastic. In the present case, as indicated below, these three 
assumptions are not perfectly fulfilled. 

_ The selection was made by classification interviewers using all 
Information available, including test scores and other factors, so 
that presumably the criterion was restricted also by selection on 
factors in addition to the test under consideration. Only the grades 
Of graduates have been studied; if those for dropped trainees had 

een included, the criterion would have been less homogeneous. 

he effect of this additional restriction on the criterion is, in gen- 
eral, to lower the apparent validity of the test. Furthermore the 
ther selection factors (in addition to test scores) tend to be used 
' such a way that deficiencies in one qualification are compensated 


for : à n : ep ; 3 В 
ai a higher standing in another. For example, if a cutting score 
20 were established as a qualification for a given school, a man 

ly if he were unusually well 


Wi 
ith a score of 47 would be accepted only 1 
Qualified by previous background or if his other test scores were 


the restricted sample, 
the unrestricted population. 
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considerably higher. If, in general, two selection devices are so used 
that men who are low in one are accepted only if they are high in 
the other, the correlation coefficient between the two devices in the 
selected group is systematically lowered, and the apparent validity 
of each device is also lowered more than the mere restriction in 
range would indicate. The general effect, then, of using multivariate 
selection rather than the single variate selection assumed by the 
formula, is to produce an underestimate of validity, and the values 
reported in this study are probably systematically too low. 
Violations of the assumptions of rectilinear regression and homo- 
scedasticity can produce either underestimates or overestimates. If 
the line representing regression of the criterion on the test is nega- 
tively accelerated, or if men with high test scores are more variable 
on the criterion than those with low test scores, the result will be 
again an underestimate of what the correlation between the test and 
the criterion would have been if an unselected recruit population 
had been sent to school. A positively accelerated regression line or 
larger criterion variation for low test scores would result in an over 
estimate. The negatively accelerated curve, following the general 
principle of diminishing returns, is more likely in a situation 0 
this sort. 
, Another effect of selection upon the obtained validity coefficients 
1$ not corrected by Kelley's formula. If the regression is curvilinear: 
a selected group with a mean test score higher than that of the 
recruit population but with as large a standard deviation will show 
a lower validity if the regression line is negatively accelerated an 
a higher one if it is positively accelerated. In general, insufficient 
data are available to determine the shape of the regression line 1) 
an unselected group, so that no correction can be made except t° 


note that the reported validity coefficients are probably underest™ 
mates of the true values. 


In addition to the techni 
means and standard deviati 
sheds some light on the rel 
schools. These means, of c 
cedures in operation at the 
ing the requisite ability we 
dence of validity and help 
performance. 

For determinin: 
dicting school suc 


que of correlation, the comparison а 
ons for the graduates of various schoo’ 
ation between test scores and success S 
ourse, reflect primarily the selection pro 
time; but to the extent that trainees lac i 
T€ not graduated, the data give some e 
to determine appropriate standards of t° 
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trative reasons, however, fractional weights for tests were not con- 
sidered practical in actual field operations; therefore the test com- 
bination was selected for which the simple sum of the scores had 
the best predictive efficiency. With a test battery in which the test 
intercorrelations are relatively high and all tests are expressed in 
standard scores, the two techniques are almost equivalent; they 
usually result in the same combinations of tests and indicate ap- 
proximately the same predictive efficiency. The reason for this is 
that with high inter-test correlation coefficients, if the second test 
adds much to the usefulness of the first test, the weights obtained 
by the multiple correlation technique are usually almost equal. The 
formula for obtaining the correlation coefficient of the summed 
score of two tests with the criterion, when both tests have equal 
Standard deviations, is: 

T x= Tax + Tos 

(a+b) Гә (] a+ Tap) 


Where ais the first test, 
b is the second test, 
and x is the criterion; 
Tax is the validity of the first test, 
ћи is the validity of the second test, 
and rq, is the correlation between the tests. 


relations used were those obtained 
population (Chapter VI). The test 
ere not computed. The effect of 
bination of two or more tests 


In this study the test intercor 
9n several samples of the recruit 
Intercorrelations for each class W 


Selecting trainees on the basis of a com Е 
is to lower the test intercorrelations in the selected group more than 


the restriction in range of either test would indicate. If, for example, 
а man with a low score on the General Classification Test is assigned 
to school only provided he has а high score on the Arithmetical 

easoning Test, and vice versa, the result is a инв 
number of people in the selected group who are high on one test 
and low on the other. The effect of this phenomenon 1s to lower the 
test intercorrelations in the selected group. In the few school classes 
Where the test intercorrelations were computed, they were found to 


е markedly low. = 
Since ee standard deviation of the sum of ex tests a pum 
by th 2 = + дтубхбу the use of a va ue 
e formula, onp = Vor + 0 4 : 
for T, that is too high will give а Lapicined ~ value On ia 
variability of the sum of two tests In а school class. When the $ 
y ge is used, the correction 


mula for :on for restriction in Tan 
correction for T - 5 
Obtained is too low; and the net result is an underestimate of what 
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the correlation coefficient between the criterion and the sum e 
two tests would have been if the unselected recruit population hac 
been sent to school. 


Findings 


Basic Test BATTERY Vauipiry DATA. In the presentation of the 
validity data, the elementary schools studied have been divided into 
three groups. This grouping is partly on the basis of the results of 
the validation study, but it follows closely a rational classification 
made before the Basic Test Battery was constructed. 

Group 1 Schools. The schools included in Group 1 train per- 
sonnel for the following ratings: aviation ordnanceman, aviation 
radioman, fire controlman, fire controlman (O), hospital corps, 
quartermaster, radarman, radioman, signalman, storekeeper and 
yeoman. The General Classification Test and the Arithmetical Rea- 
soning Test tend to be most useful in predicting success in Group 
l schools, which are characterized by stress on verbal material and 
the ability to use symbols. 

'The validity coefficients for Group 1 schools are shown in Table 
1-хп. The figures are the simple weighted means of the validity 
coefficients for the classes of each school type. Separate data have 


2, not primarily because the 
rent, but because during the 
hanges took place in the cut 
methods, in grading practices, 
g trainees, 


The General Classification Test, Reading Test, and Arithmetical 


Reasoning Test all show high predic 


est, .21 for the Mechanical Know™ 


ore), and .30 for the Mechanical Know! 
edge Test (Electrical Score). 


In comparison with Form 1, 
for Form 2 show, in general, 
General Classification Test aver. 
Reading Test of .02 and a decre 
Reasoning Test. 

The test means and standard а. 
ard Scores) for Group 1 schools 
evidence that the graduates hav 


the corrected correlation coefficients 
an increase in the validity of p^ 
aging about .055, a decrease for th 
ase of about .07 for the Arithmetica 


a5 5 nd- 
€viations (expressed in Navy t is 
are shown in Table 9-хи. Ther the 
€ been selected on the basis of 
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tests or on variables correlated with the tests, since most of the 
means are above 50 and most of the standard deviations are below 
10. The rigid use of a cutting score of 50 would yield a mean of 58 
and a standard deviation of 6 in the selected group. 

This degree of selection is approached on Form 1 of the General 
Classification Test in all schools except those for aviation ordnance- 
men, radiomen, and signalmen. Except for quartermaster schools, 
Form 1 of the Reading Test and Arithmetical Reasoning Test shows 
much less evidence of selection. 

For two of the fourteen schools in Group 1, Fire Controlman (O) 
and Hospital Corps (WR), data were available for only one of the 
forms. In the twelve schools where data are available for both forms, 
the increase in the mean score from Form 1 to Form 2 is 5.2 for the 
General Classification Test, 11.3 for Reading Test, and 11.4 for 
Arithmetical Reasoning Test. The standard deviations for Form 2 
are 1.6 lower for the General Classification Test, 0.2 higher for 
Reading Test, and 1.2 higher for Arithmetical Reasoning Test. 

"Three factors enter into the differences between the mean scores 
Оп the two forms. (1) As the classification program became more 
definitely crystallized, the degree of selection in terms of test scores 
Probably increased. The lower standard deviations for Form 2 of 
the General Classification Test point in that direction. (2) The time 
of year in which the Form 2 data were collected for this study would 
also point toward higher means, since the trainees involved in the 
Study reported here were inducted during the May-August period 
for Which mean test scores for the entire recruit population run 
high (Chapter VI). (3) Finally, there are some differences in the 
Calibration of scores on the tests of Form 2, so that a given group 
Will obtain somewhat higher means and standard deviations on 
Form 9 than on Form 1, especially for the Reading Test and the 
Arithmetical Reasoning Test. 

Although the mean scores are higher on Form 2 for all the schools 
Where comparison is possible, the relative standards for the different 
Schools remain about the same. The rank-difference correlation 
Coefficients between Form 1 and Form 2 means for the twelve schools 
are about .80 for the General Classification Test, Arithmetical Rea- 
Soning Test, or the sum of the two. . 

In general the averages of the mean scores on the six tests are 
high for quartermaster, fire controlman, storekeeper, and aviation 
Tadioman schools. For radio, hospital corps, “gn al, aud yeoman 
Schools, these averages аге low. The other schools fall in between. 

The validity coefficients of the summed scores of indicated Fa 
for Group 1 schools are shown in Table 3-хп. Тће addition of a 
Second test to the "best" single test sometimes raises and sometimes 
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lowers the validity coefficient, with the overall result being a smal 
increase. The multiple correlation coefficient for the same са ағ 
tion of tests scores is only slightly higher than the validity ia 
of the unweighted sum. The slight gain in validity coefficient ied 
ably would not, in general, justify the addition of a second test К 

the first. But less shrinkage of validity in future samples may: ВЕ 
expected from using the summed scores of two tests than from using 


TABLE 3-хи. Group 1 Schools: Correlation coefficients between sums о 


Scores on two tests of the Basic Test Battery and final school grades for 
graduates of fourteen tyes of elementary Naval "Training Schools 


Validity ава 
Coefficient Validity t 
Pair of Tests Based on camen 
Naval Training Test Whose Summed Score Summed Multiple for GC I 
School Form Has Highest Validity Score R and AR 
54 
Aviation Ordnancemen i vd e 2 48 
E ; 45 
Aviation Radiomen : с X ME "a PERAD = p 52 
58 
Fire Controlmen bd T MER а 50 56 
Fire Controlmen (0) 2 ССТ READ 49 51 48 
: l ССТ READ or ARI 46 AT 46 
H 
apie eatis | 2  GCT--READorARI 50 72 D 
Hospital Corps (WR) 2  ССТ | READ 59 62 4 
Quartermasters f 1 eer FARI ES = 47 
1 RE | : 66 
Radar Operators | 2 dera d РЧ 60 
" 1  GCT.LARI 36 36 36 
із READ + ARI 25 25 ya 
| 1  GCT.LARI 47 47 4 
Signal | READ + ARI 43 44 at 
GCT + ARI 5 6 5 
Storekeepers 12 ССТ + ARI Fi an .59 
1 READ 55 
Storekeepers (WR) | 2 GCT ae r1 [^ P 
a E) ~ 
1  GCT.LARI 61 59 
Yeomen | ССТ + READ 48 49 48 
l  GCT.LARI 8 ‘68 68 
оу 12 GCT} READ Р 55 5i 
inen on the “best” single test, since а broader predictive base 15 
used. 


If, for purposes of administ: 


men to this group of schools as а group, the use throughout of the 
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General Classification Test plus the Arithmetical Reasoning Test 
would result in an average loss of validity of less than .02. Success 
in Group 1 schools can be predicted sufficiently well for classification 
purposes using the sum of scores on the General Classification Test 
and Arithmetical Reasoning Test as the predictive index. The chief 
exceptions are the radio schools, for which the Radio Code Test has 
been developed. 

Group 2 Schools. Group 2 schools have in common an emphasis 
on mechanical subjects, together with some technical informational 
content. Included are the basic engineering schools and the schools 
for training aviation machinist's mates. The validity coefficients are 
shown in Table 4-xu. All of the basic tests of the battery show sub- 
stantial validity coefficients but the three mechanical tests and the 
Arithmetical Reasoning Test run higher than the General Classifi- 
cation Test and Reading Test. 

_In comparison with Form 1, Form 2 validity coefficients are higher 
in the mechanical tests and somewhat lower in the Reading Test 
and Arithmetical Reasoning Test. In the case of the basic engineer- 
Ing schools, this change can be definitely attributed to a modification 
in the grading system whereby the shop subjects were given greater 
relative emphasis in determining school grades at the time the Form 
2 data were obtained; a similar change in the procedures used in 
Srading may also have taken place in the electrical schools. 

. The means and standard deviations for Group 2 schools are shown 
in Table 5-x1. The small number of school types does not warrant 
detailed comparison of test means, but aviation machinist’s mate, 
electrica], and diesel graduates average somewhat higher than basic 
Engineering and machinist’s mate graduates on the Arithmetical 

€asoning Test and the Mechanical Knowledge Test. | 

Table 6-x1 shows validity coefficients for selected combinations 

Of tests for Group 2 schools. The best single combination for the 


8топр as a whole is that of the Arithmetical Reasoning Test with 


either the Mechanical or Electrical Score of the Mechanical Knowl- 


саве Test—the Electrical Score for the electrical schools, the Me- 
chanical Score for the others. The validity coefficients for the com- 

inations of test scores range from .48 to ‘65, indicating satisfactory 
Predictive efficiency. In Forms 4 and 5 of the Basic Test Battery, 
800d results may be expected for Group 2 schools from the sum of 
the proposed Arithmetic Test and Mechanical Test, since the former 
test is to include arithmetical reasoning and arithmetical computa- 
Чоп items, and the latter test is to include mechanical comprehen- 
sion, and both mechanical and electrical knowledge items. 

Group 3 Schools. While Group | schools involve a minimum of 
mechanical content and Group 2 schools combine mechanical and 


D X 
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symbolic or theoretical material, Group 3 schools approach purely 
mechanical assembly-disassembly content. Included in this group 
are the gunner's mate and torpedoman schools. The test validity 
coefficients for these schools are given in Table 7-xu. On Form 1 
both parts of the Mechanical Knowledge Test predict fairly well, 
but the General Classification Test and Reading Test also make a 
substantial contribution. On Form 2, used at a time when the 
grading system probably placed somewhat greater emphasis on the 
shop subjects, the Mechanical Knowledge Test scores show higher 
validity, while validity coefficients for the General Classification 
Test and Reading Test decrease in magnitude. 

The test means and standard deviations in Table 8xi show the 
torpedoman school graduates to score higher than the graduates of 
gunner’s mate schools, especially on both parts of the Mechanical 


TABLE 6-xi. Group 2 Schools: Correlation coefficients between sums of 


scores on two tests of the Basic Test Battery and final school grades for 
graduates of five types of elementary Naval Training Schools 


Validity Validity 
Pair of Coefficient Coefficients 

N.: Tests Whose Based on for ARI 

aval Training Test Summed Score Has Summed Multiple -+ MKM 

School Form Highest Validity Score R or MKE 
Aviation Machinist’s Mates 2 МКМ + MKE 65 65 

Basic Engi Р 1 ARI + MEM 64 65 6: 

ius ^ S ЈЕ ARI + MKM 65 66 ‘65 
1 GCT + MKE 50 50 48 
Electrical 1 АВІ- МКЕ 62 62 62 
МАС и {2 ARI + MKE 60 60 60 
st's Mates 1 MAT + MKM 52 52 49 


Knowledge Test. In comparison with the other schools, evaluating 
€ach school in terms of the tests most appropriate for it, the torpedo- 
man schools show test standards somewhat higher than average, 
while the gunner’s mate schools are considerably below average. 

_ Table 9-x11 shows the validity coefficients of selected test combina- 
ons for Group 3 schools. Both schools show the same pattern: for 
Bees 1, the best combination was Reading Test plus the Mechani- 
» Score on the Mechanical Knowledge Test, while for Form 2 the 
n combination was the Mechanical Score plus the Electrical Score 
T ~ Mechanical Knowledge Test. The sum of the two parts of 
is echanical Knowledge Test is a satisfactory combination and it 
S probable that the Mechanical Test of Forms 4 and 5, which con- 
Sists of mechanical comprehension, mechanical knowledge, and 
electrical knowledge items, will be adequate for the selection of 
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gunner's mate and torpedoman trainees without the addition of 
other test scores. 

SPECIAL Tests or THE Basic Test Batrery. Three other tests are 
essentially a part of the Basic Test Battery but are treated separately 
here. They are the Spelling Test, Clerical Aptitude Test, and Radio 
Code Test—Speed of Response. The Radio Code Test and Form 1 


Tanie 9-xu. Group 3 Schools: Correlation coefficients between sums of 
cores on two tests of the Basic Test Battery and final school grades for 
graduates of two types of elementary Naval Training Schools 


Validity 
Coefficient Validity 
Na "m Pair of Tests Based on Coefficients 
val Training Test Whose Summed Score г Summed Multiple for MKM 
School Form Has Highest Validity Score R + MKE 
Gunner's Mates 1 КЕАР + МКМ 47 E 40 
2 МКМ + MKE or MAT 56 56 56 
Torpedomen 1 READ + МКМ 42 42 42 
2 МКМ + MKE or MAT 49 53 48 
> 


на 10-хп. Correlation coefficients (raw and corrected for restriction 

range) ! between scores on Form 1 of the Special Tests of the Basic Test 

Battery and final grades for graduates of seven types of elementary 
Naval Training Schools 


— 
Test 
Clerical 
N г li Aptitude Radio Code 
Naval Training PE за“ за —— Y : 
School Classes Graduates r Te T Te r Te 
Quartermas 
3 ters 12 424 17 JT 29 42 
ове 16 1,013 По 22 48 5 29 59 
Pier 8 '635 90 23 32 — 46 29 36 
siorekeepers 2 4 363 25 25 32 43 01 01 
vorekeepers (WR) 2 241 28 27 se B 
von 6 274 273 3954 эв 29 
fomen (WR) 6 1,190 s M 38 46 


1 = 
Kelley, Truman L. Statistical Method. New York: Macmillan, 1924, p. 225. 


id Class, 64 graduates. 
Classes, 97 graduates. 


of the Spelling Test and Clerical Aptitude Test were given over 
the same period of time as Form 2 of the tests previously discussed, 
es the validity data were gathered from the same classes for which 
"orm 2 data have already been presented. 

The validity coefficients for these three tests are shown in Table 
0-x and the corresponding means and standard deviations in 


. 
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Table 11-xu. The Spelling Test does not predict success 2 с А 
the schools studied well enough to justify its addition tot Е а 
tests. The Clerical Aptitude Test has fairly good validity coeflic ту 
for most of the schools listed, and in the classes where oe. 
is possible it is the best single test for yeoman and signal sc 


TABLE 11-хп. 


ial 
Means and standard deviations on Form 1 of the 5реста 
Tests of the Ba 


: tar 
sic Test Battery for graduates in seven types of elementary 


raining Schools 
Naval Tra g nmm 
Test 
Clerical . de 
Number Number Spelling Aptitude Bebo. 
Naval Training of of $ — M 8 
School Classes Graduates M с M с 
Quartermasters 12 61.8 10.0 62.0 6.6 1 7.1 
Radio 16 1,013 59.8 8.5 60.5 7.2 68. 83 
Signal 8 635 61.6 8.6 609 66 x Sa 
Storekeepers 1 4 363 61.6 10.0 63.1 74 59. 
Storekeeper (WR) 2 41 64.7 10.2 649 65 95 
Yeomen 2 6 4 623 85 635 6.6 62.5 
Yeomen (WR) 6 1,190 63.4 ПА 64.1 6.7 


TABLE 12xir, Comparative validi 


А inations of 
ty of single tests and combination 
tests of the Basic Test Batter 


Y in six types of elementary Naval 
Training Schools 


Correlation Coefficients between Test Scores and 
Final School Grades 


Single Test Combination of Tests 


___ Combination of Tests __ 
Naval Training 


CT + 
GCT+ GCT4 GCT Tig 
School Gor tem, CANO CLER ARI Teo 
Quartermasters 48 41 42 49 2 
Signal 44 37 46 2 49 а 
Storekeepers (WR) ‘5g 44 48 51 55 " 
Storekeepers 58 54 43 59 55 и 
Yeomen 47 35 54 43 55 j^ 
Yeomen (WR) 65 50 46 ‘61 61 E 

ols 
The Radio Code Test is effective only in the case of radio t 
and is the only one of t l 


es information on the 


sate of thE 
: comparative validity d 
ation Test, A 


rithmetical Reasoning Test, 


6 
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Clerical Aptitude Test, and the sums of the most plausible com- 
binations. In these six types of schools the best single test appears 
to be about as satisfactory as the best combination of tests in pre- 
dicting success. 

VALIDITY OF THE INTERVIEW. The effectiveness of the interview as 
a selection device is difficult to estimate because interviewers always 
had test scores before them as they made their evaluations. The 
quantitative result of the classification interview was recorded as the 
quality classification” and is described earlier in this chapter. 

| A sample group of 37,862 trainees was studied to observe the rela- 
поп between quality classification and success in nine types of 
clementary schools. The trainees were divided into three groups 
according to whether they (1) failed the school, (2) graduated as 
qualified strikers (apprentices for a rating), or (3) in the case of those 


Taste 13-x1; Distribution of trainees in nine types of elementary Naval 
Training Schools according to quality classification and 
success in training 


Cases assigned to Quality Classification by Classification Interviewers 


1. 2. 3. General Detail Total 


Relative Success —À 
Categories N pA N %1 N ГА; N ГА N [A 


9.70 507 25.68 2,803 7.40 


Failure 
17 i 4.11 1,82 
Graduated i3 78 3.47 636 
Qualified Striker 4,110 80.15 13,016 84.09 13,047 85.38 1441 73.00 31,614 83.50 


ee with 
ating 40 пао 752 492 26 132 9445 910 
pe alt. 1,974 37,862 


Total 5,1284 15,479 15,281 


1 А . 
Base for percentage is total in the quality classification. 


received petty officer rating at gradua- 


with pronounced proficiency, 
the relationship between the 


i" The contingency table showing 4 
variables is shown in Table 13-xm. The coefficient of mean 
‘quare contingency is .23. Although this denotes some relationship, 
10 is not as high as the validity coefficients of the appropriate tests 
ог the same schools. The fact that the data for all classes of all nine 
Schools were pooled may serve to obscure somewhat the predictive 
“ficiency of the quality classification. . . ; 
he four categories of quality classification evidently contribute 
"nequally to the relationships; that is, there 15 comparatively little 
ifference between classifications 1 and 2, and only a moderate 
ifference between classifications 3 and 1 or classifications 3 and 2. 
he Sharp difference is between "general detail" on the one hand 
and classifications 1, 2, and 3 together on the other. In other words, 
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. и we 
the interviewer was only moderately successful in paese d pun 
would do best among those recommended for school tra a eder 
he was markedly successful in determining who should go 
and who should go to "general detail". | — 
The actual order of assignment to school involved bot кар 
classification and the school recommendation. The — m 
might assign as a first recommendation either (1) a pec equ oe 
for a particular elementary school, or (2) а recommendation 4. we 
eral detail. If the first recommendation were for assignment tn 
elementary school, it was mandatory that the second г ера 
tion also be to an elementary school. If the first recommenda € 
Were assignment to general detail, the second ангайн ty 
might be assignment to an operational school. When both qs е 
classification and recommendation were considered, the continget s. 
coefficients between order of assignment and graduation ranged h hip 
-22 to .35. They show throughout a lower degree of relations 
than the appropriate tests for the same schools. fej ays 
In another study of 3,246 graduates of electrical schools, и ке 
found that the correlation ratio between quality classification pow 
school grades was .41. For the same group, the uncorrected corr siii 
tion coefficient between school grade and the sum of the ROME 
cal Reasoning Test plus the Mechanical Knowledge Test t 
Score) was .50. То evaluate concretely this difference in predic n 
efficiency, the success of quality classification 1 men was compared em 
пе same number of top scoring men on the Men 
Knowledge Test re) alone. Of the 333 men in qua 


i Ы 2 -adua- 
ighty-one received a rating at gra 
tion. Of the top 333 men in the i 


s 3 ience 
Tvilewer’s evaluation of expe ega 
ively small and may well be choo! 
be noted that prediction of $ 


~ : liste 
ns of the interview. The En the 


ABLE 14-хи. Distribution of trainees in eight types of elementary Naval 


Training Schools according to age 


— 


Percentage of Final School Grade 
Trainees in —— 

Naval Training School Age Group Each Group M с 
Aviation Machinist's Mates 17-21 33.3 82.15 3.69 
(N = 766) 29.96 44.3 8434 26l 
27-30 13.3 84.19 3.33 
31-38 9.5 83.51 3.47 
stags All AMM Trainees 83.52 3.33 
viation Ordnancemen 17-21 49.0 84.48 3.77 
(N — 1,230) 22-26 25.4 86.31 3.93 
27-30 15.6 86.08 3.60 
31-38 10.0 86.08 4.21 
Avian : All AOM Trainees 85.36 3.93 
viation Radiomen 17-19 -70.2 84.45 4.56 
(N = 1,125) 20-22 17.1 85.04 4.86 
23-25 8.7 84.29 4.12 
26-38 4.0 84.68 4.67 
El . All ARM Trainees 84.55 4.58 
€ctrical (N = 1,930) 17-21 27.6 82.90 7.02 
22-26 22.3 85.06 6.74 
27-31 23.2 84.95 6.62 
32-36 21.8 84.43 6.88 
37-42 5.1 83.95 7.13 
All EM Trainees 84.24 6.90 
Quartermasters (N = 1,189) 17-21 25.1 85.67 7.59 
22-26 31.9 85.58 7.13 
27-31 21.7 85.55 6.08 
32-36 17.8 85.92 6.88 
37-44 3.5 85.02 5.50 
All QM Trainees 85.64 6.94 
Radar Operators = 10.5 81.07 6.45 
(N = 1,946) 22-26 41.8 82.39 6.47 
27-31 93.9 82.06 6.88 
32-36 18.8 81.57 6.61 
37-42 4.9 79.21 6.79 
Bas: All RdM Trainees 81.86 6.52 
adio (N = 1,158) 17-21 87.63 6.17 
22.96 18.5 87.02 6.36 
27.81 12.9 86.81 5.75 
32-38 7.9 86.24 6.78 
Si All RM Trainees 87.30 6.21 
епа] (№ = 1,483) 17-19 74 83.99 6.87 
20-23 10.6 84.25 7.26 
24.97 10.5 86.00 6.47 
28-31 7.0 87.08 6.00 
32-38 45 85.73 7.25 
84.52 6.90 


АП SM Trainees 
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any questions he may have. The interviewee also has an wei 
to express his interests and point of view, and quite apart on ni. 
predictive value the information may have, the mere fact o d 
having had individual attention and an opportunity to be hear 
probably valuable from the morale point of view. | 
AGE AS A PREDICTIVE Factor. The relation between age and schoo 
grades is shown for several schools in Table 14-хи. In general, Eom 
between 22 and 36 years of age are more successful than those belov 
22 or over 36. a 
The product-moment correlation coefficients between age an 
grades assigned in school are shown in Table 15-x11. Since the rela- 
tionship has been found to demonstrate a pronounced curvilinearity; 
the correlations understate the amount of relationship present. For 


TABLE 15-хп. 


. А ана 
Correlation coefficients (product-moment and biserial) 
between age an 


d final grade for trainees in eight types of elementary 
Naval Training Schools 


— 


Naval Training School Product-moment r Biserial r+ 


Aviation Machinist's Mates -200 


379 
Aviation Ordnancemen .195 275 
Aviation Radiomen 908 040 
Electrical 081 155 
Quartermasters .002 -006 
Radar Operators 081 135 
Radio —.069 —.080 
Signal 141 .148 


= „red 
1 The dichotomy was between “favored age” and “non-favored age,” where the mon 

age group was between 22 and 36 years of age and the non-favored ages were hele 

and above 36, 


“favored”, rather th 
coefficients indicati 
for aviation machi 
school, .28. 


T 
pes 16-хи. Distribution of trainees in eight types of elementary Naval | 
raining Schools according to amount of civilian education in years 


Amount of 
Civilian Percentage of Final School Grade 
Naval Trainin Education Trainees in ————— 

g School in Years Each Group M с 

Aviation Machinist's Mates 0-8 3.8 82.64 2.97 
(N = 766) 9, 10, 11 274 8209 5.62 
12 57.8 84.00 3.11 
13 and over 11.0 84.86 2.43 
nw All AMM Trainees 83.52 3.33 
ation Ordnancemen 0-8 6.4 84.17 4.08 
(N = 1,230) 9, 10, 11 35.0 84.16 3.79 
12 50.1 86.12 3.76 
13, 14, 15 8.0 86.76 3.77 
16 and over 0.6 84.78 3.28 
Avion All AOM Trainees 85.36 3.93 
Viation Radiomen 0-8 1.9 84.31 3.49 
(N = 1,125) 9,10, 11 323 8385 4.53 
12 58.0 84.83 4.62 
13 and over 75 85.46 4.37 
Elect; All ARM Trainees 84.55 4.58 
€ctrical (N = 1,930) 0-8 11.8 81.72 6.89 
9, 10, 11 34.9 82.15 7.01 
12 46.7 85.90 6.27 
13, 14, 15 6.3 87.79 5.75 
16 and over 0.9 86.38 5.92 
All EM Trainees 84.24 6.90 
Quartermasters (N = 1,189) 09 3 8390 645 
10, 11 7.7 83.72 7.08 
12 514 85.57 7.12 
13, 14, 15 29.4 86.24 6.32 
16 апа оуег 9.3 86.15 7.28 
All OM Trainees 85.64 6.94 
Radar Operators pU 6 80.32 7.24 
(N = 1,946) 9, 10, 11 14.8 79.40 6.69 
12 62.0 82.02 6.26 
13, 14, 15 16.6 82.72 6.77 
16 and over 5.1 84.62 5.89 
Radi АП ВАМ Trainees 81.86 6.52 
adio (№ = 1,153) 08- 6 87.68 5.97 
9, 10, 11 38.1 85.86 6.37 
12 51.8 88.08 5.98 
18, 14, 15 8.6 87.97 6.31 
16 and over 0.7 87.25 4.79 
Si All RM Trainees 87.30 6.22 
gnal (№ = 1,433) 0-8 5. 82.96 7.27 
9, 10, 11 41.7 82.81 6.64 
n 12 448 85.57 6.76 
^ 13 and over 7.8 88.69 5.69 
84.52 6.90 
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tion coefficients and the biserial coefficients. For the latter the dicho 


omy was completion of high school versus non-completion. Useful 
relationships are found in the following cases: 


Tots. 
Electrical school 37 
Aviation machinist's mate school 36 
Aviation ordnanceman school 32 
Radar operator school 24 


А 4 28 
asis for assignment poen dé 
ow the relationship of test маа 
these graduates, so that the pr 


Naval Training School 


Product-momentr Biserial r! 
Aviation Ma 


chinist's Mates 


0 

Aviation Ordnancemen lu ET 

©- Aviation Radiomen 061 181 
Electrical ! : 219 371 

`- Quartermasters 049 .156 

a Radar Operators d 5 .244 

.. Radio .008 .188 

s Signal 161 156 


e 5 ће 
failu sized. 

importance of civilia ducati T€ would have empha that 

i of c n éducation, In general, it is probable t 

years of education" contributes i | 


little in addition to test scores, 
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GENERAL CLASSIFICATION TEST SCORES IN RELATION TO REASONS 
For КАПАЈКЕ. The records of 46,500 trainees assigned to ten different 
types of elementary schools were examined to determine the rela- 
tionship between scores on the General Classification Test and 
failure in school. Of the trainees, 11,000 obtained General Classifi- 
cation Test scores which were below the cutting score recommended 
for the school to which they were assigned. Presumably such assign- 
ments had been made because of quota pressure and because those 
Individuals had some such unusual qualifications as specific experi- 
ence, marked interest, or favorable personal qualities, which might 


TABLE 18-хп, Percentage of failure among trainees of ten types of ele- 

mentary Naval Training Schools whose scores on the General Classifica- 

"on Test were (1) below the cutting score; and (2) above the cutting 
score, classified according to reasons for failure 


Percentage of Failure Percentage of Failure 


Among Men with Among Men with 
GCT Scores Below GCT Scores Above 
Cutting Score. Cutting Score. 

N = 11,000 N = 35,500 


Reason for Failure 


Lack of Aptitude 


In general aptitude for school 5.5 1.2 
For practical work 3.0 0.8 
Sein; Total 8.5 2.0 
Poor Motivation 
of interest or appreciation 4.9 1.2 
referred sea duty or other school 5 3. ~ gf 
„Total i p Bd te ribns i 
Miiplinary Problem g 8 ^ Iu 3 ~ 
Iscellaneous (death, illness, dis- ? a ses 
charge, etc.) 11 sti з 
15.8 49. 


All Reasons 


Counterbalance a slight deficiency in the General Classification Test 
Score. The scores on other tests of the Basic Test Battery were not 
taken into account in this study. Table 18-xit shows the percentage 
ОЁ the “above cutting score” and “below cutting score” groups who 
failed for each reason, for reasons related to inaptitude or poor 
Motivation, and for all reasons. Despite their non-test qualifications, 
the rate of failure of men with scores below the cutting score was - 
More than three times that of men who met the cutting score. The 
Contrast becomes sharper if the comparison is made only on factors 
for which prediction by selection tests can be expected. If the miscel- 
aneous reasons such as death, discharge, and serious illness are 


^ 
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excluded, it is found that almost four times as many of those below 
cutting score fail as those above cutting score. This represents a 
degree of predictive efficiency equivalent to a tetrachoric coefficient 
of correlation of .53. : 
The reasons for failure presented in Table 18-xir are those given 
by the school instructors. While the reasons as given are probably 
of doubtful validity, the data for the reason "lack of interest or 
application" are of special interest. More than four times as many 
of the below cutting score group failed for lack of interest as did those 
who were above the cutting score. The predictive efficiency is equiv- 
alent to a tetrachoric coefficient of correlation of .51. This is pre- 
cisely the area of selection for which an aptitude test might be con- 
sidered least useful and for which subjective and intuitive interview 
data are considered necessary, and yet rigid mechanical use of objective 
test scores would have reduced attrition from alleged poor motiva- 
tion very substantially. When it is considered that many of the 
below cutting score groups were presumably assigned just because 
their high interest and serious intent were judged to compensate 
for their low aptitude, it is apparent that the entire area of “іп- 
terest,” as it appears to the classification interviewer and to the 
School instructor, merits further study. It may be, for example, that 
"lack of interest" is the result of lack of aptitude, or it may be that 
"Jack of interest" is a charitable way of describing a cause of school 


failure. In any case the whole subject requires much more intensive 
research. 


Summary of Results by Predictive Factors 


- Tue Basic TEST BATTERY—GENERAL TEsts 


- . Verbal Tests. The General Cl 


. are similar in predictive efficien 


í assification Test and the Reading 
est predict success well in most of the schools studied. Only in the 


radio school and in three schools with a distinct mechanical empha- 
sis (machinist’s mate, gunner's mate, and torpedoman) do the cor- 
rected validity coefficients fall consistently below .40. The two tests 


al Classification Test for the meas 
urement of verbal ability. 


Arithmetical Reasoning Test. The data from Form 1 indicate that 
the Arithmetical Reasoning Test is the most generally useful test 0 


A. . H B 1 
the battery, considering all schools in all groups. This conclusion 1 
substantiated by the results presented in the fleet validation study 


Elementary Enlisted Schools 259 


(Chapter XX) and by data from a research study carried out aboard 
the USS New Jersey showing a close relationship between scores on 
the Arithmetical Reasoning Test and attainment of petty officer 
status. The kind of ability measured by this test appears to be gen- 
erally useful in naval ratings even when the school or the job is not 
notably quantitative in nature. The lower validity coefficients for 
the Arithmetical Reasoning Test on Form 2 may be partly attribut- 
able to the very high mean scores of the classes studied, with the 
result that a large portion of each class had as high a level of the 
ability as the school demanded. This explanation implies a curvi- 
linear relationship between school grades and scores on the Arith- 
metical Reasoning Test. 

The Mechanical Tests. These three tests (the Mechanical Apti- 
tude Test, and the Mechanical and Electrical Scores on the Mechan- 
ical Knowledge Test) predict success in the schools with an obvious 
mechanical emphasis. But the data provide little basis for assigning 
Personnel to different mechanical schools by their different scores 
on the three tests. The Electrical Score of the Mechanical Knowl- . 
edge Test, for example, is as good as the Mechanical Score and better 
than the Mechanical Aptitude Test score for predicting success in 
the diesel, machinist's mate, and gunner’s mate schools. This would 
appear to indicate that electrical knowledge is highly important in 
schools where, in fact, electrical subjects are not stressed. . 

A possible explanation of the anomaly is that the Mechanical 
Knowledge Test (Electrical Score) is operating as a test of mechani- 
cal aptitude. Many of the items rest upon fairly casual observation — 
of common electrical equipment such as toasters, telephones, and “ë , 
doorbells, A large proportion of the testees have had the necessary 
Opportunity and environmental exposure to arrive at the answer if _ 
they have the requisite aptitude and interest. On the other hand, 
Many of the Mechanical Knowledge Test (Mechanical Score) items | 
relate to specific tools which are encountered only in a metal work- 

Ing shop. The fact that more people have had the necessary experi- 
ences for answering the Mechanical Knowledge Test (Electrical 
Score) items correctly tends to make this test operate as an aptitude . 
test. The aptitude involved apparently is sufficiently general to ђе 
"Important in clearly mechanical schools. . . IN, v" 

The Mechanical Aptitude Test has two sections testing (1) spatial 
Perception and (2) mechanical comprehension; it may, therefore, be 
On too abstract а level to correlate highly with success in these 
Mechanical schools. In other words, a test constructed and designated 
as an electrica] knowledge test may measure certain aspects of me- 
Chanical aptitude better than tests designed to measure mechanical 

Nowledge or mechanical aptitude. In this connection it may be 


e 
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noted that in Forms 4 and 5 of the Basic Test Battery, mechanical 
comprehension, mechanical knowledge, and electrical knowledge 
items have been combined to form the Mechanical Test. 


Tue SPECIAL TESTS 


Spelling. The Spelling Test showed insufficient predictive ећ- 
ciency to justify its continued use, especially in view of its high inter- 
correlation with the General Classification Test. 

Clerical Aptitude Test. The Clerical Aptitude Test predicts suc- 
cess well not only in the yeoman and storekeeper schools, but also 
in quartermaster and signal schools. Insufficient data are available 
to evaluate the test’s usefulness for a wider range of schools, but the 


validity coefficients for quartermaster and signal schools (where the 


clerical aspect is not especially prominent) suggest that the Clerical 
Aptitude Test may m 


еазите speed and accuracy of repetitive per- 
ceptual operations. 


Radio Code Test—Speed of Response. This test predicts success 

fairly well in the radio school only, and it is the only test that 1s 
effective for radio school. It should be noted, however, that the data 
in Chapter XX show a substantial correlation between the General 
Classification Test and success of radiomen in the fleet. 
: Since these conclusions on the nature of the functions involved 
in the tests of the Basic Test Battery are somewhat speculative, con- 
siderable caution is indicated in setting up selection requirements 
on the basis of the names of the tests and the obvious features o! 
the assignment. Since an electrica] knowledge test predicts success 
in schools which are not electrical, an arithmetical reasoning test 
1s generally useful for most schools whether or not they stress arith- 
metic, and a clerical aptitude test works well for schools that аге 
not particularly clerical in content, the need for caution in using 
tests because they have the "right" names is indicated. 


OTHER PREDICTIVE Factors 


. Interview. Data on the “quality classification” indicate that the 
interview adds little if anything to the predictive value of the tests 
At 50 ons for school failure, such as “lack of i" 
terest or application,” can be predicted by aptitude tests although 
they are usually considered as factors which should be a praised by 
the interview technique Ri 


Age. Trainees between 22 and 36 years of age receive somewhat 
better school grades than those beyond those limits but the relation- 
ship is not close. : 

Education. Amount of civ 


f ilian education, in the absence of apt 
tude test scores, is of some value in predicting school success but 
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И 
Ене little additional information when test scores аге avail- 
able. М 

The data presented in this chapter indicate that success іп ele- 
mentary enlisted schools can be predicted effectively by means of 
the general and special tests of the Basic Test Battery. The most 
effective combination of tests for Group 1 schools is that of the 
General Classification Test and the Arithmetical Reasoning Test. 
Success in Group 2 schools is best predicted by the Arithmetical 
Reasoning Test plus the Mechanical Knowledge Test (Electrical or 
Mechanical Score), depending upon the particular type of school. 
The Mechanical and Electrical Scores of the Mechanical Knowledge 
Test proved the best combination for Group 3 schools. Judging from 
the results obtained from Forms 1, 2, and 3 of the Basic Test Battery, 
the four tests (singly and in combination) of Forms 4 and 5, as 
described in Chapter VI, should provide effective tools for the pre- 
diction of success in the Navy's elementary enlisted schools. . , 


CHAPTER XIII 


PREDICTION OF SUCCESS IN 
ADVANCED SERVICE SCHOOLS 


ADVANCED enlisted service schools are designed to provide instruc- 
tion at advanced levels for men who have had elementary school 
training or experience in rating, ashore or afloat (Chapter V). Until 
nearly the end of the war, trainees were assigned to these schools 
without the benefit of systematic selection requirements. Owing to 
pressure of classification and training problems on the elementary 
level, studies in the prediction of success in advanced schools were 
postponed until late in the war. Two studies were begun in the 
summer and early fall of 1944 in (1) Naval Training School (Fire 
Control—Advanced), and (2) Naval Training School (Gunner's 
Mates and Electric Hydraulics). Preliminary reports on these 
studies, recommending cutting scores for selection of trainees, were 
issued in December 1944 and January 1945. The rest of the studies 
summarized in this chapter were not begun until April 1945. At that 
time the Test and Research Section was requested by the Enlisted 
Classification Section to initiate studies in certain advanced schools 
leading to the preparation of selection requirements comparable to 
those which had been worked out at the elementary school level. 


Nalure of Advanced School Programs 


The researches reported in this cha 
fraction of the total number of adv. 
personnel. All of the schools studied 
enlisted personnel for Nay 


Pter are concerned with only T 
anced enlisted schools for nava 


(2) type of content, (3) amount of 


АП € schools studied, together 
with the length of training programs, and the general nature of the 


ADVANCED SCHOOLS FoR Moror MACHINIST’S MATES PS 


1. NTSch (Diesel)-A, 18 weeks. Advanced general training i? 


diesel engines—not a factory school concerned with a special make ° 
engine. 
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_ 2. NTSch (Diesel)-B. 4 weeks. A factory school providing special- 
ized training on certain types of diesel engines. 

3. NTSch (Diesel)-C. 5 weeks. A factory school. 

4. NTSch (Packard Marine Engine). 8 weeks. A factory school. - 


ADVANCED SCHOOLS FOR ELECTRICIAN's MATES 


5. NTSch (Electrical Interior Communications) (EIC School). 26 
weeks. The program of this school is highly intensive and extremely _ 
technical; the most advanced of any of the electrician’s mates schools. 
The curriculum contains a great deal of mathematics (including 
some calculus) and electronics theory at the level of the last two 
years of an electrical engineering course. Trainees for this school 
Were selected from the schools described below. . 

. 6. NTSch (Electrician's Mates). 18 weeks. An advanced electri- 
cian’s mates school. The curriculum includes considerable mathe- 
matics and electronics theory, but the level is less advanced than that 
of the EIC School. T - 

7. NTSch (Gyro Compass). 16 weeks. An advanced electrician's | 
mates school. Specialized training is provided in repair and main- 
tenance of gyro circuits and equipment. The level of training is 
Somewhat advanced compared to school 6, but not so intensive as 
School 5. 


ADVANCED SCHOOL FoR GUNNER'S MATES 

8. NTSch (Gunner's Mates and Iflectric Hydraulics). Length of 
course varied—average 12 weeks. The curriculum covers basic elec- 
tricity and fire control, basic hydraulics, 40 mm. gun and mount, and 
5"/38 caliber gun and mount. This school was included in the set 
Of studies begun in April 1945, although it had been studied earlier, 
1n the summer and fall of 1944. By the time the later set of studies 
Was begun, two curricula were being offered. These differed mainly 
In level of difficulty. The potentially better students were placed in 
an advanced course; the remaining students in a primary ie 
À Tomising graduates of the primary course sometimes were place 


i 
n the advanced course. 


ADVANCED Ѕсноот, FOR FIRE CONTROLMEN | 

9. NTSch (Fire Control—Advanced). Length of course Lise 
COnsisted of a basic course of 8 weeks, and specialized courses o 
varying lengths (3 weeks to 24 weeks) concerned with special types 
О equipment. Most of the specialized courses were 8 or 10 p. 
length, A preparatory course of 4 weeks was given for men E П 
sidered deficient in background for the basic course. The basic 
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course covered elementary electricity, basic fire control, basic hy- 
draulics, and standard assemblies. The specialized courses were con- 
cerned with gun directors, computors, and other fire control equip- 
ment for particular guns. The longest course (24 weeks) was a repair 
course covering a wide variety of fire control equipment. 


ADVANCED SCHOOL ron WATER TENDERS 


10. NTSch (Oil Burning). 


6 weeks. Advanced training in opera- 
tion and maintenance of high 


pressure steam boiler systems. 
ADVANCED SCHOOLS FOR SONARMEN 


11. West Coast Sound School. 5 weeks. Advanced training in 
operation and maintenance of so 


Reasons advanced 


for this policy, despite th 
of standards, were: 


(1) failure could not be 


Populations Available for Selection of Trainees 


‘Trainees for the advanced service schools came from a number of 
differer 


nt sources. Some were graduates of elementary schools who 
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were immediately sent on for advanced training; some were assigned 
from shore duty stations to prepare them for further duty ashore or 
afloat; still others were men returned from sea duty. All varieties 
and lengths of Navy experience were represented. Not infrequently 
a given school group included all pay grades from unrated men to 
chief petty officers. The age distribution was correspondingly wide. 

The heterogeneity of Navy experience represented in the ad- 
vanced school population complicated the prediction problem. The 
relationships between experience and such factors as motivation, ad- - 
justment to the school situation, study habits, and personal and 
family problems, are difficult to evaluate but are nevertheless real 
in their influence on training success. It seems reasonable to expect 
less uniformity, with respect to these imponderables, in the popula- 
tions with which these studies dealt than in the groups assigned to 
elementary schools. Training officers frequently expressed the 
Opinion that men returned from sea duty were poorly motivated. 
They tended to regard their training assignment as a shore duty 
vacation which had been earned by their months or years in the Р 
fleet. Reports of training officers indicated, also, that men returned 
from sea duty had more personal and family problems that inter- 
fered with study, and that in general they experienced more diffi- 
culty in adapting to the school situation. 
: The variations in composition of the groups available for selec- 
tion of advanced school trainees at different times may be illustrated | 
by data from the advanced fire control school. For four groups 
different enrollment times, the ranges in 
Proportion of men from various sources were as follows: (1) returned 
from sea duty, 41 per cent to 85 per cent; (2) from elementary service 
School, none to 55 per cent; (3) from instructional duty (generally at 
elementary service schools), from none to 13 per cent; (4) from other 
duty, 1 per cent to 13 per cent. As time went on, more and more 
men returning from sea duty became available for advanced train- 
Ing and fewer elementary school graduates were immediately as- 
Signed to advanced training. But within this. long time trend the 
Composition of the population available for assignment to any school 
Was also subject to short time fluctuations. The composition of these 
Populations, at any given time, was therefore a variable and uncer- 
tain matter, 


Studied, representing four 


Procedures 


SAMPLES бтортер. The foregoing discussion of the populations 
available for selection of advanced school trainees indicates that the 
problem of adequate sampling was difficult. Solution of it would 
have required careful preliminary study of the groups available for 
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se 
Systematically selected groups were tho 


ates 
ools. The elementary school gradua 
selected for immediate assignme 


А : raining. 
those who had proven most apt in their elementary traning: 
Trainees for NTSch (Electrical Interior Communications) pene 
special case of this kind of selection, although in this instance se 


а ol, 
nees assigned to another advanced scho 
о an elementary sch 


; tion standards probably preventeo 
these groups from being more systematically assigned. One wou а 
expect locally determined standards, based On intuition rather tha 

research 


me 
ven been expressed by wl p 
р 

at least occasiona 
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tended to use the advanced schools as dumping grounds for their 
undesirables. r 

A considerable number of cases had to be eliminated from some 
samples because data on them were lacking. In only two of the 
studies, at NTSch (Gunner's Mates and Electric Hydraulics) and 
at the Advanced Fire Control School, were the tests given at the 
Schools by the investigators. In all other studies the schools were 
requested to supply the data from the men’s Enlisted Personnel 
Qualifications Cards. Men who had come into the Navy prior to the 
establishment of classification centers in recruit training stations 
often had no Qualifications Cards in their service record jackets. 
Occasionally such men had been’ interviewed and had a Qualifica- 
“ons Card partially filled out, but frequently so much data was 
lacking that the cards were of little value for research purposes. A 
large proportion of men with long sea experience fell in this group. 
Hence, the samples were systematically biased by the exclusion of 
individuals for whom data were not readily available. 
| Prepiction Data. The prediction data for these studies were con- 
fined almost entirely to those conveniently available from the En- 
listed Personnel Qualifications Cards. These included Basic Test 
Battery scores, rating and pay grade, age, Navy training records, 
length of Navy service, civilian occupation, and civilian education. 
In only one instance (the Electrical Interior Communications 
School) were other prediction data used. In this case, since all men 
Were assigned to this school from NTSch (Electrician’s Mates), their 
Previous school grades were obtained. 

Certain limitations of these Qualifi 
noted. 

1. For some schools, data with respect to certain prediction vari- 
ables, particularly scores on certain tests, were too incomplete to 
Permit estimation of the relationships of those variables to success 
In the schools concerned. : Р 

2. The data on civilian occupational experience was unsatisfac- 
tory. It was necessary to rely on the codes of civilian occupations that _ 
had been recorded by classification interviewers. Even assuming that 
Coding was always accurate, the codes had the following flaws: (a) 
Different coding systems were used in the classification program at 
different times, and the particular coding system employed on each 
Individual could not always be determined. (b) The same numerical 
code was sometimes employed in two coding systems, but with dif- 
ferent meanings. (c) One of the coding systems failed to provide a 
means of making important distinctions concerning degree of skill 
In certain occupational groups. Data not coded in conformance with 
the Dictionary of Occupational Titles were discarded. А 


cations Card data should be 
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3. Men took tests at widely different stages of Navy experience, 
a fact which probably influenced their scores on certain of the tests. 
Those men who were inducted into the Navy after classification 
centers were established in recruit training stations were tested dur- 
ing their recruit training. Men who entered the Navy prior to the 
establishment of the classification program were tested, if at all, 
following months or years of Navy experience. For such tests as the 
Mechanical Knowledge Test (both Mechanical and Electrical Scores) 
this difference in stage of Navy experience at which men were tested 
was probably important. Testing a man’s knowledge of tool rela- 
tionships after he has had several years of experience as a motor 
machinist’s mate does not measure aptitude for diesel school train- 
ing in the same way that it is measured if the test is taken prior to 
such experience. 

4. The Basic Test Battery was designed primarily as a tool for 
classification at the recruit training level to aid in assignment of 
men to training in elementary schools. It was not intended for the 
special job of measuring aptitudes for advanced school training. It 


is probable that better prediction at the advanced school level could 
be obtained from tests 
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assigned by the schools are, by definition, the criterion of success. 
Certainly the immediate concern of the Navy was to assign to 
schools those trainees who could pass the courses. It was necessary to 
reduce attrition rates as much as possible, so that the largest number 
of trained men could be available to the fleet in the shortest period 
of time, Except for a program designed to meet an immediate urgent 
need, however, the question of how accurately the grading systems 
reflect the ability of school graduates to perform on the job ought | 
not to be ignored. Studies are badly needed to validate both the 
curricula and the grading systems against job performance. 

, Final grades were generally averages of quizzes and written exam- 
Inations together with laboratory performance ratings of some sort. 
Paper and pencil quizzes and examinations in the advanced schools 
Were ordinarily unstandardized and of unknown reliability and 
validity. They were usually made up by the instructional staffs of 
€ach school, most of whom were not skilled or trained in test con- 
struction. Such tests quite frequently measure a verbal factor more 
than the knowledge and skills which they are designed to measure. 
They may, therefore, do an injustice to the student who lacks verbal 
facility, but who, nevertheless, has mastered the essentials of the 
curriculum. v 1 

А Laboratory grades were generally based on instructors’ observa- 
tions of the very limited number of men under their immediate 
laboratory supervision, and the grades were assigned without the 
aid of standardized laboratory performance tests or carefully con- 
Structed check lists or rating scales. Moreover, instructors were 
ordinarily not skilled raters, and were as subject to the usual “сеп- 
tral tendency” and “leniency” errors as any other unskilled raters. 
Statistical evidence on this point was available from only one school. 
School records, in this instance, made it possible to obtain separate 
averages for laboratory grades and written test grades, as well as a 
final average including both. This school seems to have been more 
than usually aware of the difficulties involved in assigning such 


ratings and had made efforts in the direction of improving and 
Standardizing rating procedures. Even so, the dispersion of labora- 
tory marks was much smaller than that of quiz and examination 


Srades. The average standard deviation of laboratory marks for two 
Classes in this school was 2.4 as compared to an average standard 
deviation of written test grades of 6.7.. | М ) 
Part grades were usually combined into à final mark by taking 
the simple average of the part grades, ог by computing a weighted 
average in which the nominal weights assigned were made M. 
Чопа] to the judged importance of the part grades. Itis RE ey 
Whether functional weights were ever considered. In the case ot the 
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Advanced 
Primary 


For Fire Controlmen : 
Fire Control-Advanced 


Graduating Group 
GroupI 
Group II 


Group III 


For Water Tenders 
Oil Burning 


^ GroupI 
- Group IL 
For Sonarmen 
‘West Coast Sonar 
. Fleet Sonar 


D 


152 M 587 
с 7.6 
200 M 494 
a 73 
100 M 62. 
o 71 
203 M 590 
с 82 
14 M 601 
с 8.8 
72 M 605 
с 8.0 
173 M 492 
с 113 
169 М 487 
с 8.6 
143 M 613 
с 77 
11 M 60.7 
с 79 


56.2 
8.8 
477 
8.6 


58.5 
7.8 
513 
7.7 


1 Pay grades were given the following numerical values: 


Chief Petty Officer—1 
First Class Petty Officer—2 


_ Second Class Petty Officer—3 
Third Class Petty Officer—4 
Seaman or Fireman First Class—5 


61.5 
6.4 
54.8 
6.8 


48.6 
9.1 
50.0 
9.0 


745 
85 


63.7 
9.7 


67.2 
9.0 


10.9 
16 

10.0 
19 
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Б ratory 
school mentioned above, the written test grades * d 
grades were considered to be equally а бг ri неу aE 
both types of grades were, therefore, given unit weig UMS 
the final average. But when the quiz grade averages iens epe а 
with final grades a coefficient of .98 was obtained, eap | on 
correlation between laboratory grade averages and p^ Sedi 
yielded a coefficient of .55. It is highly improbable that this 
was unique in making such errors in procedure. TR. 
Considering the characteristics of the criterion data whic = Es 
just been described, it is not surprising that validity operi им 
prediction variables are often low. Neither should it be wes “3 
that tests, like the General Classification Test and the Reading ar 
which are largely measures of verbal ability, often show almost se 
relationship to grades in mechanical schools with tests purport ~ 
to measure mechanical aptitude. Estimation of the true pce 
ships of predictor variables to some measure of performance pnr 
research in which the criterion measures receive their due share 
attention. РА 
METHODS оғ ANALYsis, The analysis was principally отне 
For continuously distributed variables, such as test scores, ребре 
moment correlation coefficients were computed. Biserial coefficien d 
were used to analyze the relationship between the criterion ме 
attendance ог non-attendance in related elementary service schools. 


The Wherry-Doolittle procedure? was employed to select the ptt 
bination of three tests which would yield the highest multiple p! 
diction. 


Results 


STATISTICAL DESCRIPTION OF POPULATION, 
` the means and standard dev 
data from the Enlisted Per 
cerning civilian occupation 
served for later presentation b- 

For most of the school groups, the test score means show а mon 
stantial increase and the standard deviations a definite атак 
from the corresponding statistics for Navy recruits. The groups fro 
NTSch (Oil Burning) are an exception to this. The means pe 
standard deviations from these groups are just about what a 
would expect from samples of recruits. Likewise, the primary 510 nü 
from N'TSch (Gunner's Mates and Electric Hydraulics) shows из 
significant differences with respect to mean test scores, althové 
there is a definite shrinkage in standard deviations. Differences ~“ 

1 Stead, W. H., Shartle, C. L., et a]. Occupational Counseling Techniques, pp- Bere 
American Book Co., New York, 1940. 


Table 1-хш present 
lations of test scores and other pet 
sonnel Qualifications Cards. Data а 
and prior naval school training are 1 
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the recruit population with respect to test score performance ap- 
proach a maximum in the groups from NTSch (Electrical Interior 
Communications). 

The particular system of dividing trainees at NTSch (Gunner's 
Mates and Electric Hydraulics) into primary and advanced groups 
accounts for the differences between these two groups shown in the 
table. Following the earlier study at this school, which was begun in 


the late summer of 1944, the school’s program was reorganized to- 


provide these two different curriculum levels. The recommendations | 
for selection of trainees resulting from the earlier study were fol- 
lowed, as closely as possible, in assigning men to the advanced cur- 
riculum. The residue from this selection process, together with men 
thought unqualified for the advanced work because of deficiencies 
in background, were placed in the primary course. 

. Wherever the differences in test score means and standard devia- 
tions are substantial, they indicate the operation of some selection 
Process, although distributions for certain tests might be expected 
to show restriction in range and higher means where men took tests 
at stages of Navy experience later than recruit training. The extent 
to which these differences represent selection from the populations 
available for assignment to the particular schools is not known, how- - 
ever. The test score distributions for these populations, had they 
been known, might have shown an equal degree of selection as com- 
pared to a group of recruits. For example, the men assigned to 
NTSch (Electrician’s Mates) and NTSch (Gyro Compass) appear to 
be rather highly selected. Their test score means on the General 
Classification Test, Arithmetical Reasoning Test, and Mechanical 

ptitude Test are all well above those for Navy recruits; and the 
Standard deviations are consistently smaller. On both parts of the 

Mechanical Knowledge Test the differences are considerable. Yet 

ifferences of like magnitude could have obtained for all men 
Who were eligible for assignment to advanced electrician’s mate 
Schools. It is possible that the eligible electrician’s mate group was 

that highly selected. While it seems unlikely that the electrician 5 
Mate sample was a random sample from the available population, 
the hypothesis must be considered tenable since statistics are not 
available to disprove it. . 

The data on “months of active duty" show marked differences 
from school to school. Length of service was longest (from three and 
one-half to four years on the average) for the samples from NTSch 
(Gunner's Mates and Electric Hydraulics) and NTSch (Oil Burn-. 
ing) It was shortest for the factory engine schools (less than a 
year and a half on the average for NTSch [Diesel]—B). Many of the 
trainees in these factory schools had only recently graduated from 


Е 
- 
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Taste 2-хш. Correlation coefficients of school success with test scores and other selected personal data for samples from 
. twelve advanced Enlisted Schools. The criterion of school success was final school grades, or a linear scale transforma- 


tion of ranks derived from final school grades. 
== 
. Other Personal Data 
Mo. of Age Years of 
Test Score Active Pay in Civilian 
School N GCT ARI MAT MKM MKE READ SPELL CLER RADIO Duty Grade! Years Education 
For Motor Machinist's Mates 
Diesel A 148 52 EC 54 45 31 .00 .29 ЛІ 18 
Diesel B 107 25 32 37 27 37 13 16 15 21 
Diesel С 40 37 .32 58 34 17 17 :08 .22 4 
Packard Marine Engine 106 24 17 12 26 32 BP 1 .02 05 20 


For Electrician's Mates 
Electric Interior 


Communications 
28 .05 12 14 


Group I 119 28 35 28 09 07 24 d 
Group II 109 26 38 28 28 22 06 Al 2 10 
Electrician’s Mates 205 48 39 46 28 43 01 .80 .02 36 
Gyro Compass 59 43 46 51 4 37 09 35 08 42 


For Gunner's Mates 
Gunner's Mates and 
Electric Hydraulics 


Ist Study 154 55 46 51 44 48 63 
Advanced 152 27 EJ! 16 25 25 27 15 321 EU! A7 
Primary 202 .05 .80 17 32 22 31 .08 14 05 .26 


For Fire Controlmen 
Fire Control Advanced 
Graduating Group 100 32 


Group I 203 54 59 40 43 54 53 
Group II 114 53 55 52 AS 56 51 
Group III 72 45 59 81 39 48 53 
For Water Tenders 
Oil Burning 
Group I 173 63 66 53 50 45 .38 39 37 54 19 .88 
Group II 169 45 42 40 А7 32 32 23 50 65 15 19 
For Sonarmen 
West Coast Sound 143 21 37 23 02 36 26 19 08 26 
Fleet Sonar 11 19 38 34 03 16 22 08 21 08 25 
1 Pay grades were given the following numerical values: 
Chief Petty Officer—1 ‘Third Class Petty Officer—4 
First Class Petty Officer—2 Seaman or Fireman First Class—5 


Second Chass Petty Oficer—3 
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basic engineering schools and had been in the Navy as few as six 
to eight months. But in all cases the standard deviations of the 
length of naval service data are large. All of the samples included a 
wide range of length and type of Navy experience. 

Data on age and years of education are also presented in Table 

1-хпт, It is apparent that there were also systematic differences be- 
tween schools with respect to these factors. 
RELATIONSHIP OF PREDICTOR VARIABLES TO SCHOOL Success. Table 
XII contains the zero-order validity coefficients of the same pre- 
dictor variables for which means and standard deviations were pre- 
sented in the previous table. Since test scores and other factors 
Correlated with test scores were used in selecting men for assignment 
to certain schools, it is probable that the corresponding validity 
Coefficients are underestimates of the population values. No correc- 
tions have been applied to these data, as was done in the elementary 
school Studies, because the necessary knowledge of the population 
distributions was lacking. Additional data on the relationship of age 
to school success and on the relationship of prior Navy training and 
civilian Occupational experience to school success are shown in 
Tables 3-хш, 4-хиг, and 5-хш respectively. 

PTITUDE TEST SCORES. Among the motor machinist’s mate schools, 
correlation coefficients are highest for samples from Diesel 
Chools А and C and lowest for the Packard Marine Engine School 
and Diesel School B. Reference to Table 1-xm indicates that the 
trainees for the latter two schools seemed also to be more highly 
lected. But the:differences in restriction of test score distributions 
do not appear to be sufficient to account for all of the differences 
in correlation coefficients. Considering all schools together, the 
to аса] Aptitude Test appears to be the best single predictor 
oon the motor machinist's mate schools. It fails to correlate well with 
cess in the Packard Marine Engine School, but so do all of the 
Other tests. The Wherry-Doolittle analysis selected the Mechanical 
BIS Test as one of the most predictive combinations of three 
Wenn €ach instance, even in the Packard Marine Engine School, 
of Е € its zero-order correlation with the criterion was below that 

Our other tests. 


fies finding that this test, which includes items measuring com- 
item; Sion of simple mechanical relationships and principles and 
spatial 16293 іпе facility in spatial manipulation and perception of 
А nt ationships, predicts well for this type of school is certainly 
Set an With expectation. Indeed, one might expect a test of this 
v4 enjoy a greater relative advantage compared to tests like the 
eral Classification Test. That it did not is probably due to 
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(1) high Mtercorrelations with other tests of the Basic Test Battery, 
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"TABLE Зои. Correlation coefficients of school success with test scores and other selected personal data for samples from 
twelve advanced Enlisted Schools. The criterion of school success was final school grades, or a linear scale transforma- 


tion of ranks derived from final school grades. __ -— 
А Other Personal Data 
p ee 
Mo. of Age Years of 
Test Score Active Pay in Civilian 
School N GCT ARI MAT MKM MKE READ SPELL CLER RADIO Duty Grade! Years Education 
For Motor Machinist's Mates 
Diesel A 148 52 49 54 45 31 100 99 A 18 
Diesel В 107 25 32 37 27 37 13 16 Bt] 21 
Diesel C 40 37 32 58 34 .17 17 .08 22 34 
Packard Marine Engine 106 324 3 12 26 32 1 ll 02 05 20 
For Electrician's Mates 
Electric Interior є 
Communications 
Group I 119 28 .35 28 .09 .07 24 23 .05 12 14 
Group II 109 26 38 23 28 22 .06 al 12 10 
Electrician's Mates 205 48 .39 46 28 43 01 -30 02 36 
Gyro Compass 59 43 А6 51 44 37 .09 35 .08 12 
For Gunner's Mates 
Gunner's Mates and 
Electric Hydraulics 
Ist Study 154 55 46 51 EL 48 63 
Advanced 152 27 31 6 25 25 27 45 21 01 Dui 
Primary 202 .05 .30 47 32 22 31 08 14 05 26 
For Fire Controlmen 
Fire Control Advanced 
Graduating Group 100 32 82 26 36 54 38 
Group I 203 54 59 40 43 54 53 
Group II 114 53 5 52 AS 56 51 
Group III 72 45 59 391 39 48 53 
For Water Tenders 
Oil Burning 
Group I 173 63 66 53 50 45 .38 39 37 54 19 35 
Group П 169 45 42 40 AT 32 32 23 . 50 65 15 19 
For Sonarmen 
West Coast Sound 148 21 37 23 02 36 26 19 08 26 
Fleet Sonar 11 19 38 34 03 16 22 08 EA 08 23 
1 Pay grades were given the following numerical values: 
Chief Petty Officer—1 Third Class Petty Officer—4 
First Class Petty Officer—2 Seaman or Fireman First Class—5 


Second Class Petty Officer—3 
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basic engineering schools and had been in the Navy as few as six 
to eight months. But in all cases the standard deviations of the 
length of naval service data are large. All of the samples included a 
wide range of length and type of Navy experience. А 

Data on age and years of education are also presented in Table 
1-х, It is apparent that there were also systematic differences be- 
tween schools with respect to these factors. 

RELATIONSHIP OF PREDICTOR VARIABLES TO SCHOOL Success. Table 
2-x contains the zero-order validity coefficients of the same pre- 
dictor variables for which means and standard deviations were pre- 
sented in the previous table. Since test scores and other factors 
correlated with test scores were used in selecting men for assignment 
to certain schools, it is probable that the corresponding validity 
coefficients are underestimates of the population values. No correc- 
tions have been applied to these data, as was done in the elementary 
school studies, because the necessary knowledge of the population 
distributions was lacking. Additional data on the relationship of age 
to school success and on the relationship of prior Navy training and 
civilian Occupational experience to school success are shown in 
Tables 3-хш, 4-хш, and 5-хш respectively. 

APTITUDE Test Scores. Among the motor machinist’s mate schools, 
the correlation coefficients are highest for samples from Diesel 
Schools A and С and lowest for the Packard Marine Engine School 
and Diesel School B. Reference to Table 1-хш indicates that the 
trainees for the latter two schools seemed also to be more highly 
selected. But the differences in restriction of test score distributions 
do not appear to be sufficient to account for all of the differences 
in correlation coefficients. Considering all schools together, the 
Mechanical Aptitude Test appears to be the best single predictor 
or the motor machinist’s mate schools. It fails to correlate well with 
success in the Packard Marine Engine School, but so do all of the 
Other tests, The Wherry-Doolittle analysis selected the Mechanical 
Aptitude Test as one of the most predictive combinations of three 
tests in each instance, even in the Packard Marine Engine School, 
Where its zero-order correlation with the criterion was below that 
of four other tests. 

The finding that this test, which includes items measuring com- 
prehension of simple mechanical relationships and principles and 
items measuring facility in spatial manipulation and perception of 
Spatial relationships, predicts well for this type of school is certainly 
In line with expectation. Indeed, one might expect a test of this 
Sort to enjoy a greater relative advantage compared to tests like the 
General Classification Test. That it did not is probably due to 
(1) high intercorrelations with other tests of the Basic Test Battery, 


Taste Зои. Criterion score means and standard deviations lor four age groups in samples of trainees from ten 

advanced Enlisted Schools. Criterion scores are linear scale transformations of ranks derived from final school grades. 

Data in italics are for categories where N is less than 30. No statistics are given for categories in which fewer than 10 
cases were available. 


Age in Years 


17-20 21-24 30 and older 
Schools M с M с м с 

For Motor Machinist's Mates 

Diesel A 44.5 17.8 49.5 19.0 53.8 19.8 51.2 18.0 

Diesel B 46.9 16.0 50.4 20.8 49.5 19.9 55.3 19.2 

Diesel C 57.1 15.6 47.7 19.4 

Packard Marine Engine 48.5 17.9 53.0 19.6 53.8 17.0 
For Electrician's Mates 

Electric Interior Communications 

GroupI 523 18.5 46.5 17.5 17.2 53.1 17.1 

Group II 525 18.9 50.5 17.8 19.0 42.8 12.9 

Electrician's Mates 477 18.1 47.3 18.5 211 47.9 20.7 

Суго Сотраѕѕ 45.7 19.2 49.6 18.5 19.6 53.0 9.7 
For Gunner's Mates 

Gunner's Mates and Electric Hydraulics 

Primary 44.3 19.2 47.3 18.7 53.2 18.5 50.8 21.2 

Advanced 58.0 16.5 47.0 225 50.5 20.5 421 20.5 
For Water Tenders 

Oil Burning 45.3 18.6 46.9 17.2 58.0 19.8 514 20.6 
Еог Зопагтеп 

West Coast Sound 50.7 17.0 51.1 19.6 48.8 21.5 464 20.4 

Fleet Sonar 49.1 24.0 47.8 17.7 57.0 17.8 49.3 10.1 


Taste 4x1. Relationship of prior Navy training to success in advanced service schools. (1) Biserial correlation 
coefficients between criterion and graduation on non-graduation from an elementary Naval Training School. 
(2) Product-moment correlation coefficients between criterion and grades in prior training. 
Oil Oil 
Burn- Burn- 


Packard EIC EIC Electri- Gyro _ing ing West 
Diesel Diesel Diesel Marine Group Group cian's Com- Group Group Coast Fleet 


Schools A B С Engine I 1 Mates pass I 1 Sound Sonar 
Graduates vs. Non Graduates of Elementary Schools (1) 16 05 34 35 ла 32 25 07 09 22 08 
Elementary School Grades (2) 56 99 53 44 $5 55 37 59 46 53 54 26 
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Taste 5-хш. Criterion score means and standard deviations of samples 


according to civilian occupation group: 
school grades. Data in italics are for ca 


s. Criterion scores are linear sca 
tegories where N is less than 30. No statistics are given for cate; 


less than 10 cases were available. 


from ten advanced Enlisted Schools, subdivided 
le transformations of ranks derived from final 
gories in which 


Profesional Clerical Agriculture, Manual, Manual, 
and and Fishing, Manual, Semi- Un- 
Managerial Sales Service Forestry Skilled skilled skilled None 
Schools M с M с м с M с M с M с м с M с 
For Motor Machinist’s Mates 
Diesel A 565 123 493 200 60.0 16.2 54.0 18.3 49.8 20.0 446 16.1 
Diesel B 583 17.2 52.0 188 44.7 202 478 19.1 
Diesel C 42.2 18.7 529 137 53.9 16.9 
Packard Marine Engine 528 17.7 53.9 179 47.2 151 38.7 144 
For Electrician's Mates 

Electric Interior Communications? 

GroupI 59.8 12.6 65.6 11.6 574 135 53.9 134 574 14.2 
Group П 51.0 20.3 52.8 18.2 52.0 209 46.5 17.0 
Electrician’s Mates 441 234 48.7 17.8 52.1 19.5 46.3 19.6 57.7 13.2 49.8 19.3 
Gyro Compass 529 209 47.1 124 521 18.1 50.9 21.3 

For Gunner's Mates 

Gunner's Mates and Electric Hydraulics 

Primary 53.0 18.1 459 165 53.6 20.0 45.2 19.0 44.5 20.6 51.8 204 51.8 18.1 
Advanced 453 184 55.1 173 48.6 18.9 45.6 170 462 25.5 

For Water Tenders 
Oil Burning 49.2 184 464 216 500 190 492 179 444 174 536 1 84 
For Sonarmen 

West Coast Sound 574 158 465 177 527 14.6 48.2 215 46.7 15.2 
Fleet Sonar 50.1 17.8 50.8 10.2 48.7 19.7 484 21.0 


_ 1 Еог this group, no occupational experience data were available for failing st 
| included in assigning criterion ranks, the means for occupational categories are based on onl 
and are, therefore, higher than the corresponding means for other groups. 


udents (approximately 20 per cent). Since the failur 
у the upper 80 per cent of the criterion ranks, 
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(2) weaknesses in the criterion, including failure to evaluate "nd 
rately and give proper weight to laboratory performance, and (3) d e 
ciencies of the test itself as a predictor of ability to perform work 
of a mechanical nature at the advanced school level. | 

For two of the three electrician’s mate schools, NTSch (Electrical 
Interior Communications) and NTSch (Gyro Compass), the best 
correlation with success was obtained for the Arithmetical Reason- 
ing Test. The curricula of both of these schools are heavily weighted 
with mathematics. At NTSch (Electrician’s Mates), with a some- 
what less mathematical curriculum but with a considerable body of 
work in laboratory repair and maintenance, the General Classifica- 
tion Test and Mechanical Aptitude Test appear to be best. The 
Mechanical Aptitude Test possesses some predictive capacity for all 
of these electrical schools. A Wherry-Doolittle analysis to select the 
best combination of three tests includes it in each instance. * 

The group labeled First Study from NTSch (Gunner's Mates and 
Electric Hydraulics) is the only one from that school yielding data 
that can be compared with data from the other schools in the table. 
Data for the primary and advanced groups from this school were 


collected after the recommendations from the first study had been 
put into effect, and are interesti 


obtained from groups that have been systematically selected on the 


basis of those same test scores. In the first study the Reading Test 


he criterion. Unfor- 
this test from most 


The recommended 
combination of tests, from this First Study, was the Reading Test 


ple was subdivided into four groups 
ning at which the men were tested. 


erably greater proportion of me 
schools and fewer from sea dut 
tematically selected group. The tw 
selection of trainees for this schoo 
Test and the Mechanical Knowle 

The correlation coefficients for 
siderably between the two classes. 
correspond to the magnitude of 
corresponding tests. But not enough 
position and characteristics of the tw 


© groups to account completely 
for the differences. Taking both gro 


ups together, the General Classi- 
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fication Test and the Arithmetical Reasoning Test are probably 
best. Wherry-Doolittle analysis selects these two tests as part of the 
best combination of three for both groups. In Group II the Mechan- 
ical Knowledge Test (Electrical Score) yields a slightly higher rela- 
tionship than either of these two, but it is relatively less efficient 
for Group I. Р 

In the two sonar training schools the only tests that were found 
to be promising for prediction were the Arithmetical Reasoning 
Test and the Radio Code Test—Speed of Response. The Mechanical 
Aptitude Test showed a fair degree of correlation with the criterion 
for the Fleet Sonar School group, but a considerably lower соећ- 
cient was obtained for the West Coast Sound School sample. The 
correlation obtained for the Arithmetical Reasoning Test may be 
due, in part, to the emphasis on plotting and interpretation of sonar 
data for navigation and fire control problems in the advanced sonar 
curriculum. Unfortunately no data for the Radio Code Test were 
available from the Fleet Sonar School, so the correlation obtained 
for that test in the West Coast Sound School cannot be checked. It 
is unfortunate that Sonar Pitch Memory Test (Chapter VIII) scores 
Were not available for these trainees. Certainly, if special selection 
tests for special types of training have a function anywhere in the 
Navy's selection program, it is for such psychologically unique types 
of tasks as those encountered in sonar operation. 

Navy Exprrtencs. The correlations of “months of active duty” 
and “pay grade” with the criterion are low and of no significance 
for prediction, except for one school, NTSch (Oil Burning). The 
Teasons for this unique finding are not known, but at least two 
Possible explanations may be offered. The first is that this was the 
Опе school of the group studied in which the materials taught, 
methods of instruction, and methods of measuring achievement 
Were of such a nature as to give a real advantage to the men with 
long experience and higher rates. The second possibility is that the 
grades assigned in this school were contaminated by the influence of 
Prestige factors associated with experience and high rating. The 
thorough investigation of the methods of instruction, achievement 
testing, assignment of grades, etc., that would be needed to reveal 
the Correct explanation, was not undertaken in this study. Such 
Investigations will need to be routine for future studies if these 
Variables are to be evaluated. It may be noted in passing that even 
in the Oil Burning School the intercorrelations of “pay grade” and 

months of active duty” with Basic Test Battery scores were low— 
of the order of .10 to .20. à 

E der correlation coefficients between age and school success 

and variable. In a few cases low negative coefficients were 

ound. But it is. possible that the product-moment correlations 
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underestimated the real relationship, since the regression of age an 
school success often tends to be curvilinear. For this reason a furt = 
analysis was made. ‘The samples were divided into four age p 
and separate distributions of criterion scores for each age group WS i 
constructed. The means and standard deviations of these distribu 
tions may be found in Table 3-xm. For most schools the data in this 
table bear out the hypothesis of a curvilinear relationship. With a 
few exceptions, the mean scores show an increase from the youngest 
group (17-20 years) through the third group (25-29 years), and no 
increase or a decline for the fourth and oldest age group (30 and 
above). But the distributions for the separate age groups overlap 
considerably (note the large standard deviations). Inspection of the 
distributions therefore indicated that the relationships were very 
low, and the eias were not computed. So far as those data can be 
considered indicative, age does not appear to be of very great pre 
dictive value for selecting men for advanced training. 

AMOUNT OF CIVILIAN EpucATION. With 
group, years of education correlated 


some schools the coefficients appear high enough to be of possible 
value in selection. But the intercorrelations between Basic Test Bat- 
tery scores and years of education are, in general, so high that the 
inclusion of the latter variable adds little to prediction. In only twQ 
instances did the Wherry-Doolittle analysis select this variable 2s 
one of the most predictive combination of three, The two samples 
in which this occurred ‘were the Packard Marine Engine School and 
the primary group of NTSch (Gunner's Mates and Electric Hy- 
draulics). In both cases correlation coefficients between the Вазе 
Test Battery scores and the criterion are found to be generally low: 
In samples where reasonably good prediction could be obtained 
from test score data, the variable of years of education added nothing- 
It might be possible to find relationships between type of education 
(number of shop courses, or mathematics courses, etc.) and success 


in certain advanced enlisted schools which would be valuable for 


prediction purposes. These studies do not provide data with which 
to test this hypothesis. 


Previous МАМАТ, TRAINING. 


the exception of one 
positively with the criterion. In 
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relationship between graduation from an elementary school and 
Success in advanced school. These are the coefficients in the first row 
of the table. For the most part the elementary school graduates seem 
to have enjoyed only a slight advantage as a result of their previous 
school training. In at least half of the cases it was negligible. 

Correlation coefficients between elementary school grades and suc- 
cess in advanced schools for the elementary school graduates are 
found in the second row of the table. With one exception, a reason- 
ably good degree of relationship is indicated. The obtained correla- 
tions are probably attenuated by (1) variable time lapse since gradua- 
tion from elementary schools, (2) lack of close relationship between 
elementary and advanced school curricula, especially for men who 
were not recent elementary school graduates, and (3) unreliability 
of grading systems. The practical usefulness of this relationship is 
limited by the small proportion of eligible advanced school candi- 
dates who have attended elementary schools. The relationship might 

€come important, however, if training programs should be devel- 
Oped in which most or all of the training is done in schools, rather 
than on the job. In such a program, the selection of men for ad- 
vanced training might well weight heavily the factor of performance 
in elementary training. 

The Electrical Interior Communications School represented a 
unique case of this type of selection. All trainees for that school 
Were Selected from the men who had been first assigned to NTSch 
(Electrician's Mates), during the first two weeks of which the only 
Subject studied was mathematics, primarily arithmetic and elemen- 
tary algebra. At the end of this two week period the group to be 
transferred. to Electrical Interior Communications School was se- 
lected and Segregated for an additional six weeks in a speeded-up 
Preparatory course. During this time basic d-c theory, in addition to 
more mathematics, constituted the course of study. Accordingly, the 
Ollowing Electrician's Mates School grades were obtained for the 
EIC School trainees: (1) average grade in mathematics at end of 

Tst two weeks, (2) average grade in mathematics at end of 8th week, 

average grade in d-c theory at end of 8th week, (4) 8 weeks 
average including both mathematics and d-c theory. 

Бе orrelation coefficients between these grades in Electrician’s Mates 


ool and final grades in EIC School are as follows: 
= 


Group I Group II 


Mathematics—2 weeks average 23 40 
athematics—8 weeks average 41 61 
ue theory—8 weeks average .66 -79 


athematics plus d-c theory—8 weeks average 62 77 
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Since the selection occurred at the end of the first two weeks, the 
two weeks’ mathematics grade was the principal selection variable. 
This procedure was dictated in part by administrative considerations 
and also by the belief that the most necessary qualification for mas- 
tery of the EIC School curriculum was aptitude for mathematics. 
As a matter of fact, the data show a higher correlation for the grades 
in d-c theory than for mathematics. This difference between correla- 
tions should be interpreted with care, however, because the range of 
grades in mathematics was restricted as a result of the use of mathe- 
matics grades as the selection variable. In any case, use of a longer 
base than is provided by a two weeks grade is amply indicated. _ 
CIVILIAN OCCUPATIONAL EXPERIENCE. The civilian occupation 
data are presented in Table 5-хш. Distributions were constructed 
for each of the main occupational categories, as indicated by the 
first digit of the occupational codes. Statistics that are relatively 
unstable because of the small number of cases (N less than 30) are 
indicated by italics. No statistics are given for those categories in 
which there were fewer than ten cases. . 
Inspection of the table indicates very little possibility of predic- 
tion from these data. For example, there are such anomalous findings 
as the following: (1) At NTSch (Gunner's Mates and Electric Hy- 
draulics) one would expect men with experience in mechanical occu- 
pations, especially skilled workers, to have an advantage. Yet the 
data indicate that men with codes indicating such occupational 
backgrounds made lower grades on the average than men coded as 


having experience in agricultural occupations or in clerical and 
sales occupations, or with no civilian Occupational experience. 
(2) In the diesel sc’ 


hools there was only a very low relationship be 
tween coded level of skill in manual Occupations and school success 


In one case the semi-skilled group averaged ten points higher than 
the skilled group. Both groups tended to be below the agricultural 
worker group. $ 
The unsatisfactory character of these data has been discussed 19 
an earlier section. One additional point should be made. Тһе 
samples from the separate occupational categories were systematically 
biased by the use of occupational experience as a selection factor: 
Men with civilian occupational experience that was considered tO 
be related to some type of Navy job were assigned to training under 
less demanding standards of test score performance than were ар" 
plied to men with experience in "unrelated" occupations or with nO 
occupational experience. In addition the most promising men were 
taken from the groups with "related" Occupational experience for 
Navy jobs that were considered to be most demanding of knowledge 
and skill, or to have highest priority. Navy jobs with lower priority 


2T am 
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may have received the residue from the "related" occupational ex- 
perience groups. As a result it is likely that, at least in some schools, 
a generally higher class of men were assigned from the groups with 
no civilian occupational experience, or with experience considered 
unrelated to the training, than from the groups with "related" 
experience. 

For these reasons no valid estimates of the relationships of civilian 
Occupational experience to Navy jobs, or success in training for 
Navy jobs, can be secured from the present data. The appropriate 
procedure for obtaining this information would insure either 
(1) random sampling within each occupational group whose relation- 
Ship it was required to evaluate, or (2) collection of data that would 
enable comparisons to be made between equivalent groups, either 
by suitable fractionation of data, or by applying suitable corrections 
to criterion data. In general, samples would need to be much larger 
and more carefully designed than was the case in these studies. 


Summary 


Studies were conducted in a number of advanced service schools 
for enlisted personnel to determine the relationship of available 
qualifications data to success in advanced training as measured by 
the grades assigned by the schools. Although the studies were limited 

y Various contingencies arising from wartime conditions, certain 
tentative conclusions are possible. 

The results show that test score data can be used to predict the 
Nut grade criteria employed in these studies with, on the whole, 
ao good success. For schools whose curricula require mastery 
. à considerable amount of mathematics or facility with computa- 
tional procedures, some test of mathematical aptitude, such as the 
: аныр] Reasoning Test, has significant predictive value. For 
Chools concerned with training men for jobs of a mechanical nature, 
9r whose curricula include a considerable amount of laboratory 
Work, the Mechanical Aptitude Test was useful in prediction. At 
the advanced school level the Mechanical Knowledge Test (both 
= мы and Electrical Scores) are, in general, relatively less ећ- 
m predictors than for elementary schools. For most of the schools 
His emis: of verbal facility (the General Classification Test or 

УА eading Test) showed substantial correlation with the criterion. 
" p ability to master written materials is no doubt important 
the E MI situations, part of this correlation may result from 
pene om at grades were determined Principally from paper and 

Sts in which the verbal factor is heavily weighted. 
Grades in previous Navy training correlated well with grades in 
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advanced schools. Although not applicable to many selection situa- 
tions, this relationship should make possible good prediction where 
it can be applied. . 

"Months of active duty" and "pay grade" correlated highly with 
the criterion for the groups from NTSch (Oil Burning) but failed 
to correlate significantly in any other school. No satisfactory in- 
formation to explain this anomalous result was available from these 
studies. 


Correlation coefficients of school success with age were too low to 
be of value for prediction. 

Although number of years of civilian education showed somewhat 
higher correlations, multiple validity coefficients were not appre- 


ciably increased by the inclusion o£ this variable, owing to the high 


intercorrelations between years of education and Basic Test Battery 
scores. 


No determination of the relationship of civilian occupational ex- 
perience to success in schools could be obtained from the studies 
reported here. The data were unsatisfactory because of lack of stand- 


ard recording procedures and because the samples of various occu- 
pational groups were biased. 


PART IV 


THE CONSTRUCTION AND USE OF 
ACHIEVEMENT MEASURES 


CHAPTER XIV 


SERVICES PROVIDED TO NAVY TRAINING THROUGH 
ACHIEVEMENT EXAMINATIONS 


THE use of standardized achievement examinations in the Navy has 
been almost exclusively the result of activities during the calendar 
years 1944 and 1945. Prior to that time, locally made examinations 
had been prepared when they seemed to be required. These reflected 
the curriculum as it was taught in the particular school and the 
concepts of examining held by the individual instructor. As the 
work of the Standards and Curriculum Division in standardizing 
school curricula began to take hold, the desirability of a common 
measure of the results of instruction in a given type of school be- 
came increasingly apparent. Official cognizance of the need was 
taken during the latter months of 1943 when a request was made 
by the Quality Control Division of the Training Activity for stand- 
ardized measures of school attainment. By January 1, 1944 two offi- 
cers and a yeoman had been assigned to the construction of achieve- 
ment tests. Maximum strength of the program was reached during 
the first half of 1945. 

As indicated above, the development of the Navy's achievement 
testing program was probably most closely associated, historically, 
With the efforts to standardize curricula and instruction in Navy 
Schools. Prior to 1942 the curricula followed by the several schools 
of a given type varied extremely, although the instruction in each 
WaS presumably directed toward certain general objectives estab- 
lished by the Bureau and based upon requirements dictated by 
„Xperience at sea. To overcome in part the diversity in trainee at- 
tàinment, the preparation of uniform courses of study was under- 
taken. These standardized curricula set forth certain minimum 
essentials for all schools of a given type and represented a significant 
Step forward toward the provision of naval personnel who would 

ave common backgrounds of understanding and skill in certain 
Specialized jobs. This permitted the necessary interchangeability of 
me demanded by the exigencies of sea duty. The stand- 
Sete of curricula, however, could not in itself assure the 
каси e of this objective. There was always the possibility, for 
| е, that instructional materials and practices would not con- 
1n the desired manner. Regular visits to naval training schools 

в Tepresentatives of the Bureau of Naval Personnel provided a 
Ttain degree of supervision of instruction but did not insure strict 
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adherence to the prescribed courses of study. Furthermore the stand- 
ardized curricula alone could not guarantee a standardized product 
—the graduation of trainees possessing comparable amounts of 
knowledge, skill, and general competence in Navy ratings. The 
identification of the differences that existed between trainees after 
training became a problem of major concern. 


The achievement testing program was undertaken, therefore, 
primarily for the purposes of (1) contributing to the standardization 
of instruction in Navy schools, and (2) improving the bases for com- 
paring school trained personnel. 

To meet the needs implied in these stated purposes (the need for 
a means of assuring teaching of minimum essentials of the course, 
the need for reliable bases for marking and assigning grades, and 
the need for objective comparability of school graduates) the Test 
and Research Section undertook to provide written and performance 
examinations for training activities. These tests were planned to 
sample representative knowledges and skills of a number of courses 
of instruction. 

It is significant that although the formulation of these achieve- 
ment tests and performance problems was guided by the standard- 
ized curricula, attention was constantly focused on shipboard duties 
and functional knowledge. The requirements of the billets in which 
school graduates would serve upon completion of training were kept 
constantly in mind, and every effort was made to relate to shipboar 
practice both written examinations (through the extensive use 0 
drawings and verbally described situations requiring application O 
information to practical problems), and performance tests (requir- 


ing actual operation of gear and demonstration of skills required 
in the job). 


Types of Activities for Which Examinations Were Provided 


With a limited number of personnel available during the period 
when demands for officers in combat areas were great, it was not 
possible to develop examinations for all Navy training simulta- 
neously. As a matter of expediency it was agreed that the elementary 
enlisted training schools should receive first attention. Two criteria 
were employed in determining which schools would be considere 
first in the development of achievement tests: (1) the number 9 
trainees regularly assigned (which reflected the billets in which tht 
needs for personnel were greatest) and (2) the overall significance 
of the type of training offered. In light of these criteria the © 


struction of achievement examinations was first undertaken for thé 


enlisted schools for gunner’s mates, electrician’s mates, yeome™ 
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Storekeepers, motor machinist’s mates (diesel) and signalmen. Dur- 
ing the period from January 1944 to July 1945, performance tests 
and written examinations were prepared in from 2 to 6 comparable 
forms for the following enlisted schools and courses: 


Class P, NTSch (Basic Engineering) 
Class A, NTSch (Diesel) 

Class A, NTSch (Electrical) 

Class A, NTSch (Fire Controlmen) 
Class A, NTSch (Gunner's Mates) 
Class C-1, NTSch (Gyro Compass) 
Class A, NTSch (Quartermaster) 
Class P, NTSch (Radar Operator) 
Class A, NTSch (Radio) 

Class A, NTSch (Signal) 

Class A, NTSch (Storekeepers) 
Class A, NTSch (Torpedomen) 
Class A, NTSch (Yeomen) 
Lookout Courses 

Telephone Talker Training 


Of special note is the program of achievement examinations in its 
relation to training in the new and significant area of electronics. 
Multiple forms of examinations were prepared for pre-radio materiel 
and for elementary electricity and radio materiel schools. This 
examination program is described in Chapter XVII. 

Chronologically the development of achievement examinations 
ог officer schools followed that of the enlisted schools. During late 

44 and early 1945, standardized examinations in navigation, sea- 
Manship, ordnance and gunnery, and damage control were prepared 
and administered in the naval reserve midshipmen’s schools (deck 
Course), Officer examinations were also prepared covering subject 
Matter for the pre-radar course of instruction and for tactical radar 
‘raining, 
_Examinations for recruit training were projected from the begin- 
Ding of the achievement testing program. They were prepared and 
administered in experimental form in January 1945 with subsequent 
Tevision. for топе Use: аг completion of recruit training. The 
Examinations were comprehensive, consisting of sections of items 
representing the various areas of the recruit curriculum, namely, 
naval Organization, seamanship, military training, ordnance and gun- 
nery, fire fighting, gas warfare defense, recognition, lookout, tele- 

ene talker, and first aid and personal hygiene. 

Tom time to time, assistance in achievement examining was pro- 
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vided to additional training activities. Two forms each of a Reading 
Classification Examination, for determining pre-instruction reading 
abilities, and a Reading Achievement Examination, for measuring 
the end-of-course attainment, were prepared for and used in the 
Navy's special training program for illiterates. A number of per- 
formance and written examinations were constructed also for use 
in connection with the important amphibious training program 


under the direction of the Amphibious Training Command, Pacific 
Fleet. ; 


The Improvement of Instruction and Learning 


The services provided to Navy training through achievement 
testing were in direct response to the needs which gave rise to 
establishment of an achievement examination program. They were, 
first, those leading to improvement of instruction and learning, and 
second, those having to do with improvement of grading and mark- 
ing. 

One of the original purposes of the administration of standard- 
ized achievement examinations was the improvement of instruction 
through standardization of curricula in all schools of a given type. 
The examinations, based upon prescribed curricula for the several 
types of schools, were administered regularly in accordance with 
directives from the Bureau of Naval Personnel. Following adminis- 
tration of an achievement examination, the answer sheets were 
scored and the results converted into achievement examination 
grades for use in combination with regular course marks in com- 
piling the trainees' final course grades. These achievement examina- 
tion grades were empirically established to permit direct compara- 
bility from school to school and from one form of the examination 
to another. Answer sheets together with distributions of achieve 
ment examination grades were forwarded by the school to the 
Bureau of Naval Personnel, where measures of central tendency and 
of variability were computed for each graduating class of each 
school. The distribution of grades and other pertinent statistics меге 
forwarded to the Quality Control Division and the Instructor Train- 
ing Section of the Training Activity to be used for supervisory PUT 
poses (1) in determining the extent to which schools appeared to be 
accomplishing their instructional purposes, and (2) in recom 
mending revisions of curricula, methods, and policy as seeme 
desirable. It was thus possible, through administration of the 
achievement examinations, to obtain objective estimates of the rela- 
tive effectiveness of the schools’ programs, at least to the extent that 


the outcomes are reflected in trainee attainment on these examina 
tions. 
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While the use of achievement examination results for super- 
visory purposes constituted an important service, and while this was 
one of the basic purposes for which the achievement testing pro- 
gram was inaugurated, the local use of the examinations was per- 
haps even more significant in the overall improvement of instruction 
and learning. Early in the program of test development, repre- 
Sentatives of the Test and Research Section found that they could 
most effectively produce appropriate testing materials by working 
directly with instructors in the schools. This practice not only per- 
mitted the test technicians to develop close acquaintance with the 
curriculum and skills taught and to obtain valuable assistance from 
Staff members of the schools in the construction and try-out of 
testing situations, but it also enabled them to lend the school, in 
return, useful services by helping to interpret test results, and by 
indicating subject matter areas in which the instruction or curricu- 
lum appeared to be inadequate and in need of attention. Later in 
the program, this service became a special responsibility of field 
representatives of the Instructor Training Section assigned to school 
commands, although officers of the Test and Research Section con- 
tinued to provide advice and assistance as required. 

Special detailed analyses of the achievement examination results 
were prepared by the Test and Research Section for both recruit 
training commands and the reserve midshipmen’s schools (deck 
course). These analyses, together with adequate interpretation and 
suggestions for their utilization, were reported to each of the activi- 
tles concerned as guides for the improvement of instruction. Similar 
analyses, showing the percentages of graduates of a given school 
sponding correctly to each item or problem, were prepared and 
Beneralizations formulated to show the topics and problems that 
were being less adequately presented. 

In addition to the assistance provided to schools by item analyses, 
Participation in the development of examination materials served 
to Stimulate and guide instruction. It has been a generally accepted 
Principle in education that the experience of devising examination 
RM in areas of study aids materially in the understanding and 
m Cation of the concepts involved. Instructors in naval training 
i ca who participated in the construction of achievement 
È oa were able to better identify possible misunderstandings 

es and to adapt instruction to the trainees’ level of ability. 
a ect lopment and use of performance tests was particularly 
n in bringing about the improvement of instruction and 
naval & Opportunities. Despite the fact that the skills required of 
tion te are usually of a distinctly practical nature, instruc- 
as sometimes dominated by lectures and verbal descriptions 
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of apparatus and its operation, or at best by demonstrations = 
were assumed to be effective in acquainting the trainee with ~ 

necessary techniques and understanding. Even when dere = 
doing was undertaken, its purpose was often defeated by lack о : 
individual supervision and attention required to avoid wrong € 
ing. The introduction of performance tests immediately Laer 
attention upon familiarity with equipment and on the skills an 

understanding of procedures necessary for maintenance, operation, 
and repair. 

It was a common experience in the naval training schools that 
when trainees first were required to demonstrate individually their 
grasp of procedures or proficiency at handling equipment, the 
results were notably unsatisfactory. But after the routine adminis- 
tration of performance tests had been established, a marked im- 
provement was evident. Testimony of schools' officers indicated that 
the improvement stimulated by the testing situation was contributed 
to by a number of factors, including more carefully planned and 
executed instruction, increased opportunities for trainees to become 
familiar with equipment and procedures, and more adequate indi- 
vidual supervision of training. The extent to which this change 
was due to increased motivation on the part of the trainee or 1m 


proved instructional practices on the part of the instructors is, of 
course, difficult to estimate. 


The Improvement of Grading and Marking 


A second major service provided to Nav 


У у training by introduction 
of achievement examinati 


ons has had to do with the improvement 
of grading and marking in the schools. To the extent that the grades 
or marks are used in the classification of personnel for future assign” 
ment to billets, and to the extent to which grades are employed i” 
personnel research, any improvement over the subjective and Ut 


reliable estimates characterizing the judgments of untrained teachers 
would be of considerable importance. 


The problem of improving grades and marks as a basis for Ре" 
sonnel classification and research has been primarily one of €c ge 
cating instructors in the techniques for improving testing and marking 
practices. In the first place, it was necessary to point out the a 


vantages of objective course tests and to train instructors in the!" 
construction and use. As a result, subjectively assigned notebook 
grades and marks based on observation of Operation of equipment: 
the daily and weekly essay examinations, and poorly constructé 
true-false tests were gradually supplant 


1 ed in many schools by ae 
fully planned ratings of performance (reduced insofar as possib 
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to a "can do", "can not do" basis) and to comprehensive achieve- 
ment examinations capable of completely objective scoring. 

An outstanding example of the improvement of grades through 
the development of objective methods of achievement testing was 
found in one of the basic engineering schools. Here it had been 
discovered that the Arithmetical Reasoning Test of the Basic Test 
Battery predicted most effectively the final grades of trainees. While 
arithmetical reasoning played a significant part in the basic engi- 
neering curriculum, it was somewhat surprising to find it so closely 
associated with success in such training while scores in the Mechani- 
cal Knowledge and Mechanical Aptitude Tests showed little rela- 
tonship to attainment in this program. When objectively scored 
performance tests were introduced, the dispersion of the grades on 
shop work was increased and the relative weights of the parts of the 
Course were adjusted to approximate more nearly those that had 
been assumed to be operating. Subsequent studies of prediction of 
grades showed the Arithmetical Reasoning Test of the Basic Test 
Battery to be reduced somewhat in its prognostic value, while the 
tests of mechanical ability assumed a place of greater importance 
as predictors of success (for details of this study see Chapter XV). 

The necessary training of instructors in the use of objective tests 
and test results was accomplished largely through the efforts of 
representatives of the Test and Research Section carrying out tem- 
pos duty in the various training commands and also through 

ne development and distribution of a specially prepared bulletin, 
Constructing and Using Achievement Tests. These representatives 
е duty in the schools were continually alert to the problems of 
wae nent which confronted the instructors and assumed respon- 
y for the development of understanding of elementary con- 
Cepts related to tests and handling of test results. Considerable time 
ba Spent individually with instructors in assisting them in devel- 
Ping tests, assigning reliable grades, and in reviewing and evalu- 

ating their efforts. 
не и, Constructing and Using Achievement Tests, was of 
trainin alue in this respect and was widely used throughout naval 
itttereer activities. This manual assumed E knowledge or special 
Pener. problems of measurement on the part of the reader. It 
techies! eas basic techniques of test construction in simple non- 
with perf anguage and in concise form. Four major sections dealt 
Muni ormance tests, written tests, test administration, and the 
upon es interpretation of tests. Emphasis was placed primarily 
tests, Exa Mus ipei of tests for local use, particularly performance 
With com ples of satisfactory performance test situations, together 
plete directions for setting up equipment, administration, 
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and scoring were provided. In a section on written tests, the more 
common types of achievement examination items were presented 
and fundamental rules and principles were illustrated by example. 
The section on scoring and interpretation of test scores was particu- 
larly useful in the improvement of grading and marking in that it 
provided a simple linear conversion procedure for translating test 
scores into grades (Appendix Е-2). 

A special effort was made to improve marking in specific schools 
through an examination of grade distributions. Analyses of distribu- 
tions of schools’ grades were made by the Test and Research Section 
and reports based thereon sent to the schools. Records of the grades 
assigned to graduates were kept for each school, and distributions 
of these grades were prepared, together with basic statistics. Com- 
ments on the apparent satisfactoriness of the distributions and sug- 


gestions for modification of grading standards were forwarded 
periodically to each school. 


Plans for the Future 


The achievement testin 
restricted to those schools 
services would be of 


5 program during the war was necessarily 
or training activities where it was felt the 


CHAPTER XV 


ACHIEVEMENT EXAMINATIONS FOR 
ELEMENTARY ENLISTED SCHOOLS 


THE major objectives of the achievement testing program have been 
outlined in Chapter XIV. As stated in that chapter, the majority 
ОЁ examinations built by the Test and Research Section were de- 
Signed for use in elementary enlisted schools. It was the responsi- 
bility of these schools not only to indoctrinate great numbers of 
теп in the ways of the Navy but also to give them the fundamental 
knowledge and skills expected of them in the many specialized 
billets they would be required to fill. Ships were manned by great 
numbers of these new trainees, and the program was variously 
Praised and criticized. There was obviously a need to evaluate how 
Well the program -was serving its purpose. The specific questions 
being asked, which achievement examinations were іп part designed 
to answer, are as follows: 

(1) Are the schools giving adequate training on all aspects of their 
curricula? Assuming that the curricula were planned to meet the 
requirements of the fleet, are the trainees actually learning both 
the principles and the skills that could reasonably be expected of 
enlisted school graduates? 

(2) Are enlisted trainees being properly evaluated with regard to 
their probable proficiency in the billets to which they will be as- 
Signed? Could the prediction of which men will be most successful 
in each type of training be improved? 

(3) Are parallel schools of the same type giving uniform training? 

his is an important problem peculiar to the basic enlisted schools. 

he enormous numbers of trainees had to be accommodated in 
Many classes in several widely separated schools. The officers and 
instructors of these schools often had little or no teaching experience 
to guide them in translating the school curricula into classroom 
procedures. It was not surprising to find wide variations of emphasis 
Gin but evidence was needed to show whether there were 
us differences in achievement of men trained in supposedly 
Parallel schools, 
Can training be improved by a standardized achievement 
& program? It seemed likely that the testing program would 
зн "ni gt if it were developed with the cooperation of the schools 
овај е purpose of helping the schools evaluate their strong and 
Points. One of the most important functions of the testing 
Program proved to be the stimulation of instructor training. 
295 
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Benefits of the Achievement Examining Program 


In order to answer these fundamental questions it was ie d 
to develop new tests to measure the effectiveness of реш 
written tests typically used in the schools measured verba си и 
edge, but in many cases they did not effectively measure familia Sua 
with equipment or the ability to use it. Final grades S dins 
entirely satisfactory for evaluating the school training, since pr 
practices varied from one school to another, and practical a ме | 
was not adequately reflected in final grades. The new achievem d 
examinations were developed with emphasis on practical ability aie 
mechanical comprehension. These tests, given under uniform con ils 
tions in all parallel schools, provided more dependable ipee n 
for measuring and comparing the achievement of men and ‘al 
schools. But even more gratifying was the observation of benefici 
effects on the training program in the following ways: E 

(1) Improvement of shop training methods with more empha А 
on training men to do required jobs and to practice with Bil pipes 

(2) Standardization of the curricula by requiring men from à 
parallel schools to meet Similar standards of performance and by 
revealing deficiencies of training at any one school. b 

(3) Improvement of motivation of students and instructors РУ 


3 sien - s Р ing the 
setting realistic goals to show trainees their progress in learning t 
duties of their desired rate. 


Friendly rivalry for skill became com 

mon in several schools. 
(4) Training instructors 
make more effective use o 
uling, and to devise interes 
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ordnance, and understanding of the functions of engine parts. 
Printed booklets of such test items have been prepared for all ele- 
mentary schools with substantial enrollments. Many items refer to 
diagrams or to pictures of equipment used in training, with ques- 
tions about the function of certain parts (Figure 1-ху). Wherever 
Possible, items measure knowledge of “what to do" or how to inter- 
pret observations. 

The items can be answered on separate machine-scored answer 
Sheets. This greatly speeds the scoring when large groups are tested 
and permits repeated use of the test booklets. The main advantages 
of the printed tests are: 


(1) ease of administering and scoring . . 
(2) possibility of extensive sampling of topics by using from 
75 to 200 items in a one- or two-hour test. 


PERFORMANCE Tests. Since ability to operate and maintain equip- 
ment is an ultimate criterion of success in most Navy ratings, per- 
formance tests of sample jobs were developed for several programs 
Where the need was most apparent. For each job the trainee is con- 

onted with a set of equipment, in a specified condition, and is told 
to do Something definite with the equipment. Examples for various 
types of training follow. 


Gunner's Mate: 


“Remove and replace the extractors.” . 
"Replace the feed pawl and adjust the feed control rod. 


Electrica]: 


“Test these Synchro Units.” "M" 
ire the switches and lamp as a darken-ship circuit. 


Basic Engineering: 
“Start and check this Gray Marine engine.” И 
Start this centrifugal pump and cut in the pressure governor. 
Torpedoman: 


“Calibrate the depth spring for a depth of 10 feet.” 


isassemble the K-gun breech mechanism for cleaning, and 
reassemble it.” 


Radioman: 
‘Tune this TDE transmitter for 6,538 kilocycles.” 


Determine the true bearing of the station you will find trans- 
mitting at 1,242 kilocycles.” (With DAE direction finder.) 
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Amphibious Training: 


“Make the daily boat-and-engine check. If you find anything 
wrong tell me what should be done to correct it.” 


“Steer a compass course of 190.” (Using pivoted boat model 
with compass.) 


While the trainee does the job, a proctor watches him, marking him 
right or wrong on each step or item on a check-list. Items may be 
weighted according to their importance, and when it seems desir- 
able, bonuses may be given for speed of performance. "T" 
To economize on time, the performance tests are usually adminis 
tered in batteries of from five to fifteen test jobs, sampling various 
aspects of training. The trainees move from one set of equipment 
to another until they finish all the tests of the battery. Multiple sets 
of equipment are utilized so that more men can be tested simul- 


taneously. Often the performance tests are coordinated with other 
tests so that all the 


hours. Figure 2 
performance te 
scoring such ќе 

Performance 


A ae n 
billets it is important for the те 


а; & е- 
E aer : in order to adjust, repair, OT i 
place them. Identificat € useful for measuring familiari 
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hundred men can be tested at the same time with relatively few 
proctors. Another procedure, for large assembled units, is to attach 
numbered test cards to particular parts of the equipment. The 
trainees move from one part to the next, answering the test items. 
The identification method has also been adapted to testing knowl- 
edge of the purpose of knots, tools, and signals. The method is rapid, 
Interesting to trainees, and a good measure of their familiarity with 
actual equipment. 

Propucr-Ratinc Gaczs. In hand-tool or machine-tool shop work, 
the trainee is required to make metal products to certain specifica- 
tions of size, squareness, and symmetry. The accuracy of the finished 
Product is taken as a measure of what he has learned about laying 
out work and using tools correctly. To improve the reliability of 
grading such products, several special gages have been developed. 

160ге 4-xv shows two of the gages used in basic engineering schools. 
€ taper gage is used for measuring the diameter of a lightening 
ole, its symmetry, and the squareness of the sides. The score to be 
assigned for the diameter is inscribed on the sections of the gage, 
Penalizing the student one point for each .05 inch error in diameter. 
€ movable-pointer gage measures the distance between two shoul- 
ers On а machine-turned sample. Scores to be assigned are inscribed 
On the scale of the pointer. Instructors have found that they can 


Pla Products more rapidly and accurately with the aid of such 
ages, 


Procedures Followed in Developing Achievement Tests 


PAPER-AND-PENCIL Examinations. The development of paper-and- 
с examinations followed the procedures usual in civilian edu- 
tonal programs, A test specialist studied the school curriculum, 
pr uiis of instruction, the tests currently in use, and billet 
Уез revealing the objectives of the training. He conferred with 
Petty Officers from the schools to get a better idea of the importance 
e. Various topics, and usually had a wellinformed petty officer as- 
E to help in constructing test items, supplying plausible foils 
~ € correct answers, and editing for appropriate terminology. 
mos culled from current examinations, and new items were 
jen ante to cover any neglected topics. Considerable ingenuity 
iior ee to get good multiple-choice questions on some topics 
rather 2 measure understanding of function or correct procedure, 
and ai an mere rote memory for names or phrases. Photographs 
lagrams were used to add clarity and interest, and often several 
tems could be planned to refer to the same illustration. The 
Were designed to require from one to two hours. 


test į 
tests 
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An experimental edition of a final achievement examination was 
printed and tried out on several sample classes. Answer-sheets were 
item-analyzed to detect errors in the scoring key, ambiguous items, 
and items which did not discriminate between high- and low-scoring 
trainees. Comments from school officers sometimes indicated other 
desirable revisions: The revised test was again tried out, and from 
the try-out scores, norms were determined and tables were con- 
structed for converting raw scores to Navy grades. Several parallel 
forms of the final achievement examination were usually prepared 
to permit rotation of tests from one graduating class to the next. 
The tests, with adequate supplies of manuals, keys, and norms, were 
then distributed to instructor training officers for regular administra- 
tion in all enlisted schools. The Test and Research Section collected 


test scores and final school grades for analysis of validity and for 
comparison of schools. 


was aided by instructors in the schools. 

In devising tests, three difficulties usuall 
(1) scarcity of equipment, (2) lack of time for 
jections to testing men singly rather than i 
tribution of the technici 


y encountered were: 
testing all men, (3) ob- 
n teams. A major con- 
ans was to show instructors how to give 
s time by using more equipment and keep- 


than having an entire class stand by while 
one man was being tested. Materiel problems w 


parts of a job and by carefully schedulin 
To conserve time, multiple sets of equip 


tests were scheduled simultaneously, 50 that trainees moved from 


erformance tests, keeping busy 
by skipping routine operations, 
te screws. By sampling only the 
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in general, to be unreliable, because different instructors did not 
agree in grading trainee performance. For objective scoring, the 
Proctor’s check-sheets were made highly specific. This required 
agreement on the most acceptable procedure. From the contro- 
versies thus aroused there resulted beneficial clarification of training 
methods. The check-lists also made it possible to use student proc- 
tors to observe and score the test subjects, with one instructor super- 
Vising several proctors. Figure 5-xv shows a check-list for scoring the 
Operation of a radio direction finder. Enclosed in the box near the 
top are the directions to the proctor concerning the condition of the 
equipment at the beginning of the test, the method of scoring, and 
(in cases where tools are involved) the list of necessary tools. Ver- 
batim directions to the trainee are printed, followed by a list of all 
Items to be scored, including accuracy, sequence (where it is im- 
portant), tool use (in torpedoman or engineering tests), and speed 
(where important). The scoring is objective in that the proctor has 
no difficult decisions to make but merely observes what the subject 
does and indicates it by circling or crossing out numbers on the 
check-list. In some cases differential weights are assigned to items 
according to their importance in the training program. 

hen tryouts showed the tests to be satisfactory, manuals were 
Prepared with instructions for administering and scoring the tests, 
and for converting the scores to Navy grades (Appendix D-l). A 

Ureau representative supervised the testing until the system was 
familiar to the instructors appointed to carry on the performance- 
testing program in a school. 

Ccause they were an aid to the training program, performance 
tests Were administered during the course as well as at its end. The 
Tequency of such tests depended upon the nature of the training 
and the difficulty of setting up tests. Unit performance tests were 
Siven every four weeks in torpedoman school, every week in gun- 
Пег'ѕ mate and basic engineering schools, and three times a week 
in landing craft school. In radio school, typing and code-reception 

€nefited from daily testing during a large portion of the drill time. 
cente. TIPICATION Tzsrs. A test technician working at a training 
= = might prepare an identification test for each week of training 
"м А most of the curriculum, but іп either case the attempt 
families ect 25 to 50 significant parts that would sample the trainees 
ae with and understanding of a wide range of equipment. 
"des bs multiple-choice test, the main difficulty was to get 
te ce plausible incorrect names and functions as foils for the cor- 
in idis and functions. Six or eight alternatives were often listed 
e al tryouts, so that the best five could be retained after item- 
ysis. Repeated tryouts and revisions eliminated ambiguities and 
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DIRECTION FINDER OPERATION TEST (Model DAE) Score 


DIRECTIONS TO PROCTOR: Receiver turned off; VOLUME dial 
at "0"; BALANCER away from "0"; BAND SELECTION switch in- 


correct; two headphones plugged in (one for proctor); gyro repeater 
model within sight; calibration tables available. 


Scoring: If step is done correctly, circle the number in the score column. 


If step is omitted or incorrect, cross out the number. Cross out 
time bonus scores that are not awarded. 


DIRECTIONS TO TRAINEE: “DETERMINE THE TRUE BEAR- 


ING OF THE STATION THAT 
YOU WILL FIND TRANSMITTING 
AT 


"TIME? Start... ous Finish 


Steps Score 

Turn power "ON" and dial light “ON” 
Select proper tuning band 
Before tuning 
Switch BFO “ON” 


Unlock loop 


1 

2 

1 

1 

1 

1 

2 

PE matus ARa e ORUM UNE Bt Bie case на Гата ај kA 1 
Rotate loop for minimum signal .................0000 7 2 
Adjust BALANCER for sharper пи... 2 
Record gyro repeater reading (now, not later) 2 
Record azimuth scale reading and time 2 
Reduce volume very low 1 
Hold BALANCER in sense position (against spring pressure) .... 2 
Turn loop equal amounts to both sides of null point 2 
Interpret signal changes correctly 2 
Use Table for corrected bearing 2 
Accuracy of bearing (compared t 


F 
B 
со 
8 
o 
g 
8 
Ф 
Ф 
а 
о 
m 
nne 


From 3 to 4 minutes .. 


Figure 5-xv. Sample Check-Sheet Used by Proctor in Administration of 
Direction Finder Operation Test (Model DAE) 
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errors. The tests were then printed in manuals with complete direc- 
tions for administration (Appendix D-2). 


Results of Achievement Testing 


The sudden termination of the war prevented an extensive eval- 
uation of the growing achievement testing program, but the follow- 
ing examples illustrate the contributions of achievement testing in 
(1) improving training, (2) improving service school grades, (3) im- 
Proving the prediction of success in training, (4) comparing classes 
and instructors, and (5) measuring the achievement of schools. 

IMPROVEMENT OF TRAINING. Initial tryouts of performance tests 
frequently revealed that men could not do the jobs they had sup- 
Posedly been taught. The commonest fault of instructors was to 
assume that men could do a job after a lecture on theory and a 
demonstration. Often the equipment was not being utilized most 
effectively. For example, one radio school was proud of having the 
trainees stand watch on receivers for many hours during two weeks, 
= а room with five types of receivers. Yet when 25 of these men 
Le given a standard performance test, 16 failed completely to tune 

à specified station. Apparently, a large number of the trainees 
had been twirling dials until some station came in audibly, and 
instructors assumed they knew how to tune the sets. Needless to 
Say, the instruction was soon improved. At another school the men 
Were speedy in tuning large-ship type transmitters but had no idea 

OW to tune the more widely used ultra-high-frequency crystal set. 
сд! ап amphibious training base, tests on founen “minimum 
пен T s" revealed very poor achievement. Nearly all men failed 

n blinker receiving and compass-and-steering. On the other 
laris made very good scores on tests of markers, buoys, and 
s ist after four weeks of training. But after two additional weeks 

, raining they made poorer scores, probably as a result of boredom 
With repeated lectures. The situation called for more drill on 
iris and compass, and less repetition on markers, buoys, and 

olst, 

Ni ates working in the schools were | to suggest ways of 
equipme a raining by spending less time on lectures, breaking down 
Biden eu "i that more men could use it, and giving more shop 
ance of she supervision. Instructors, disappointed by the perform- 
peak doi ae thought of d = improve training. 
ater classes Tice an pi ias hd P oe = сета test scores in 
tion in à nad ся е фо б own — pmi -XV atare the situa- 
out in ehe oman school. Since different parallel tests were tried 
ve classes, several weeks elapsed between the first and 
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second administration of a particular test. The men did not know 
what jobs would be tested, so the improvement in performance indi- 
cated better training, or more practice by the trainees. 


0000000000000 
0000000 
00000000 
0000000000 


Assembling Turbine Bulkhead Leads 


(Perfect Score is 36) 


Figure 6-xv. Improvement of 


scores in Torpedoman Performance Test 
(assembling turbine bulkhead leads) in successive classes at a Torpedo- 


man School. 


Likewise, identification test scores im 


proved in successive classes; 
as illustrated by Figure 7-ху for the 5 
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Figure 7-xv. Improvement of scores in S 


у a Test 
5 Г mall Arms Identification 
in successive classes at 


a Gunner’s Mate School. 
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and by encouraging trainees to practice the jobs on which they may 
be tested. 

IMPROVEMENT OF SCHOOL GRADING SYSTEMS. It was frequently 
observed that practical ability, an important objective of enlisted 
training, was not adequately reflected in final school grades. The 
Schools’ usual written tests neglected this aspect of training, and 
shop ratings of practical ability were often too uniform to make 
an effective contribution to final grades. One service of standardized 
achievement examinations and performance tests was to give more 
appropriate weighting to all aspects of the curriculum. Consider, 


TABLE lxv, The relative contribution of each part-grade to the total 
Variance of the composite final grade for graduates of two classes in a 
Basic Engineering School 


ЕЧ 
Statistics of Part-Grades 
Relative Contribution! 

ClassI Class II of Each Part to 

N = 350 N = 340 Total Variance 

Part-Grades M с тт M с тут ClassI Class П 
Mathematics 83.6 77 .86 834 85 88 61 62 
Mechanical Drawing 891 41 74 877 41 72 28 25 
hop 840 25 48 83.5 26 60 п 18 


The formula! used was Ку — „У: 0! OT 


У М; а Tr š 
Where K; = relative contribution of part j to the total variance. 


1 = formal weight of part j (in this case W, = 1.00). 
9; = standard deviation of scores on part j. 
"yr = correlation of part j with composite total T. 
3 = score on part j (j being successively the three part grades). 
= W;X;. 
m This is а modification of a formula developed by Richardson. See Richardson, 
mm "Combination of Measures," in Horst, Paul, The Prediction of Personal Adjust- 


іо Supplementary Study D, Bulletin 48, Social Science Research Council, New York, 
› P. 383, 


for example, a basic engineering school where four-sevenths of the 
time was Spent in shop work and three-sevenths of the time in class- 
pats work, including mathematics, mechanical drawing, and shop 
(Tabl A survey of grades of 690 men in two graduating classes 
ем e l-xv) showed that the relatively unimportant mathematics 
5 contributed much more to final grades than did the important 
Me Work. The last two columns of Table 1-xv indicate that shop 
cite E Contribute to final grades less than one-fifth as much as do 
io grades, although they should contribute four times as 

In terms of time spent. This very small contribution of shop 
Brades might be expected in view of their small standard deviation, 
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only 2.5 as compared to a standard deviation of about 8.0 for петина 
matics grades. To correct this situation it was necessary to = 4 
mathematics less in the final average, and to increase the contribu 
tion of shop grades. 

A large ka of the shop-work grade of the first four weeks ec 
from ratings of the hand-tool work of the trainees in making "sam 
plers" to specifications. When 30 such samplers were graded by four 
different instructors, by the usual method with combination squares, 
there was great disagreement among the grades assigned to the €: 
samplers. Their ratings intercorrelated from — 11 to .55. A set o 
taper gages and caliper gages was devised, with scales for five points 
of deviation on either side of specifications (Figure 4-xv). When 
these gages were used in scoring samplers, the ratings of two different 
instructors correlated .93 on the second week sampler, and .96 on the 
third week sampler. This increase in objectivity of ratings was «3 
companied by an increased spread of grades, so that different levels 
of performance were more effectively discriminated. А 

For the last four weeks of basic engineering school, identification 
tests and performance tests were devised to measure trainees 
familiarity with naval machinery and thei 
assembling and operatin 
it also provided more d 
sion to contribute appr 

Less striking changes 
standard tests were introduced 


shop grades were not 
During test tryouts in 
scores correlated from .1 


higher with final grades, which Were based ] 
In a torpedoman school, where s 


E . an 
rom that of the written tests; 2 


more weight in final grades, 


IMPROVEMENT oF PREDICTION OF TRAINING Success, The select? E 
of prospective school trainees has been quite successful, using Qi 
school grades to evaluate the Predictions made from the Basic bs 
Battery. But it appears that prediction can be even more success 2 
if the school grades adequately reflect the special abilities desir 
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for various Navy ratings. One contribution of standard achievement 
examinations and tests is to make school grades more indicative of 
these special abilities. Consider, for example, the previously men- 
tioned basic engineering school, for which two studies of Basic Test 
Battery scores in relation to grades were made about a year apart. 
Figure 8-xv shows the correlations, corrected for restriction in range 
of scores, between final grades and scores on the six tests of the 
Basic Test Battery. In the first study, the Arithmetical Reasoning 

€st was the best predictor of success in basic engineering school, 
and the Mechanical Knowledge Test (Mechanical Score) the poorest. 
But a year later, after achievement tests and shop ratings had put 
8reater emphasis on practical ability, the Mechanical Knowledge 
Test became the best predictor of basic engineering success, and the 
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Figure 8-xv. Prediction of success in Basic Engineering School by use of 
the Basic Test Battery (before and after introduction of Achievement 
Testing Program). 


verbal and nu 
Appropriate, 


An €qually striking change in torpedoman school is illustrated in 
igure 9.ху, The solid line, representing six classes that took no 
standardized achievement examinations, shows that none of the basic 
ho tests had been very useful in predicting success. The dashed 
which еши seven contemporary classes in the same school on 
bius а dentification tests were tried out. Although test results 
Gee d E little toward final grades, the indirect influence of the tests 
final Put more emphasis on practical ability, so that the students' 
T grades more nearly conformed to their mechanical aptitudes. 

* dotted line in Figure 9-xv represents nine classes on which 
Sample Performance tests were tried out. These scores were included 


merical aptitudes became less important, as seems 


0 
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Correletion With Final Grades 


GCT READ ARI MAT MKM MKE 


Figure 9-xv. Prediction of success in Torpedoman School by use of the 
Basic Test Battery (before and after introduction of Achievement 
Testing Program). 
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Mechanical Knowledge Test (Mechanical) Grouped Scores 
Figure 10-xv. Comparison of 


tion Test of two classes. Distri 
cal Knowledge Test (Mechani 


Е 
performance оп Torpedoman identific 
butions of grouped scores on the Mech@ 


" Я r on 
cal Scores) are given to permit compar!s 
of classes. 
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in the final average, so that in this case the final grades correlated 
even more highly with the Mechanical Knowledge Test (Mechanical 
Score). These results show that wider use of practical achievement 
tests would make it easier to predict success in torpedoman school 
from the Mechanical Score on the Mechanical Knowledge Test. 
COMPARISON oF CLASSES om INSTRUCTORS. Comparison of classes 
is nearly impossible when instructors make up their own examina- 
tions. By providing a dependable basis for comparison, standardized 
achievement examinations are an aid in assigning grades that are 
comparable from one class to another. The tests can also be useful 
Іп spotting weak instruction. As an example, in a torpedoman 
school, Class 3 made much lower scores on an identification test than 
did Class 2 which had taken the same test one week earlier. The 
School officer suspected poor instruction, but the instructors insisted 


SCHOOL A SCHOOL B 
Class I Class II Class I Class II 
91-100 
А 81-90 
| al 
63-70 
0-62 
О 10 20 30 O 10 20 30 © 10 20 30 O 10 20 30 40 50 


Percentage of Students in Each Grade Interval 


== 

n Bute ll-xv. Comparison of classes in two Torpedoman Schools as to 

Performance on Torpedoman Final Achievement Examination (N = 
approximately 240 in each class). 


that Class 3 was just stupid. As the Mechanical Knowledge Test 

есһапіса] Score) was known to be the best predictor of identifi- 
Cation test scores, the plot of Figure 10-xv was made, to clarify the 
Issue, " - 

The plot is simplified to show merely the average Identification 
cs Score for men in each score interval of the Mechanical Knowl- 
us Test (Mechanical Score). The range of aptitude scores is the 

s in both classes, yet the regression line of best fit shows that 

tes a ofa given level of aptitude on the Mechanical Knowledge 
tie ^ echanical Score) make higher scores on the achievement 

ads Mes are in Class 2. Evidently there was poorer training in 
P itm The curved plot for Class 2 shows how, by better instruction, 
"à Poorest students can be brought up to a comparatively good 
*l of achievement. 
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When the same standardized tests are given in different schools 
of the same type, it becomes possible to compare classes from one 
school to another. Figure 11-xv illustrates such a comparison in 
terms of a printed final achievement examination. Grades were Te- 
ported to the Test and Research Section in five groups, with grades 
from 91 to 100 in the highest group and unsatisfactory grades (62 or 


Test Score 


Sohool A - After Ѕоһоо1 B = After 


N = 241 N = 262 
М = 101.5 M = 105.5 
50 = 12.9 20 sp = 12.5 


School A - Before 
N = 248 
M = 65,1 

SD = 13.0 


20 16 12 в 4 о о 4 g 12 36 20 
Percentage of Class Scoring in Each Step Interval: 

Figure 12-xv. Comparison of performan ic Engi 
1 ce of cl i Basic г. 
neering Schools before and after training, means by a mane 

Final Achievement Examination. 


В f 
below) in the lowest. The bar graphs show what percentas® 


, 


des in each interval. For exami e 

t of the men had асһіеуетей е 
grades from 91 to 100, 30 per cent had grades from 81 to 90, etc- Б 
no great difference betwee? E 
t the classes in School P até der 
o the classes in School A. 12 ° 
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to account for such differences, or to remedy them, specific weak- 
nesses of training must be analyzed. n 

MEASURING THE ACHIEVEMENT OF SCHOOLS. Achievement tests can 
be used to show how much a class has gained from its training, to 
answer those who consider school training to be useless. To measure 
the gain, classes in two basic engineering schools were tested before 
and after their training course, with parallel forms of the printed 
final achievement examination. Form II was given to the beginning 
classes, and Form I was given after the course was completed. The 
two forms were constructed with very similar items, and had been 
shown to give practically identical scores. In Figure 12-xv the results 
of the study are shown, with School A on the left and School B on 
the right. The crosshatched areas indicate the overlap of scores be- 
tween men who scored highest on the first examination and the men 
who scored lowest on the later examination. It is clear that there is 
а great increase of knowledge after instruction at either school. It 
18 also apparent that the trainees at School B scored slightly higher 
than those at School A, both before and after training. Some ob- 
Servers had considered the training at School B to be much superior, 

Ut from this test there is no evidence that trainees gained more at 
School B than at School A. 

If an achievement test is subdivided by topics, a more adequate 
analysis can be made of strong and weak aspects of training in 
Various schools, This is illustrated in Table 2-xv by the final achieve- 
deamination for recruit training. The 300 items of the test 
the t icon into nine topical sections, listed in the first column of 
харон "à For each part-score the means and standard deviations are 
standin for four different training centers. If there were any out- 
boven ng deficiencies at one training center, they should become ap- 
А t from this detailed comparison of test scores. But the only 
6н €nt trend in Table 2-xv is that trainees from Center B show 

perior achievement in total scores and in all sections except Gas 
са Defense. If it were known that recruits of similar ability 

© sent to all centers, one could conclude that the training at 
wo te was definitely superior. By comparing scores of later classes 
Sd t reported in Table 2-xv, school officers could observe 
on not there was improvement of ар on specific topics. 

fs on oe or MOTIVATION. Although t e are no statistical 
and use er cues Mk was consistently затей that the development 
and mud shop tests teste? E. e ee qnm of instructors 
ion or mec Ost instructors, having felt oe or better evalua- 
мете E nes ability, were pleased to fin at performance tests 
Hits y feasible. And when students performed poorly, the 
3 were quick to try to improve training. The students were 


Taste 2-xv. Achievement of recruits at four Naval Training Centers as indicated by means and standard deviations 
on the Recruit Training Final Achievement Examination, Form 1 


Center A Center B Center C Center D 
Recruit Training N = 589 N = 858 N = 644 N=617 
Final Achievement Number — —— a —— 
Examination Section of Items M с м с м с M c 
Naval Orientation 40 24.22 4.90 27.93 4.63 26.30 4.65 24.44 4.92 
First Aid and Personal Hygiene 25 17.13 4.82 20.78 3.76 18.87 4.63 17.20 5.78 
Seamanship 80 38.26 9.32 50.10 9.80 40.54 10.03 42.38 10.92 
Recognition 30 18.54 5.11 23.10 4.57 19.78 5.23 20.00 5.40 
Lookout 25 17.10 3.89 20.88 2.81 17.84 3.93 17.60 4.06 
Telephone Talker 25 1414 421 17.67 3.54 16.80 4.09 16.62 4.28 
Ordnance and Gunnery 25 13.04 2.94 14.51 2.70 15.75 2,94 13.56 3.22 
Gas Warfare Defense 25 15.61 3.83 15.09 2.94 1414 3.41 13.50 3.73 
Fire Fighting 25 11.85 3.78 16.55 4.06 14.32 4.24 13.70 5.21 


Total Test 300 169.56 32.93 206.91 29.81 182.08 32.58 178.99 37.28 
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also impressed by the importance of performance tests. Even the 
least motivated of them took pride in making good performance 
records, although they might not take the written tests seriously. 
Identification tests stimulated interest in learning about all kinds 
of equipment. After a test the students would discuss parts among 
themselves or with instructors, and in at least one school the com- 
Parison of parts from different torpedoes became a favorite pastime. 
It seems likely that improvement of test scores resulted from in- 
creased motivation of students as well as from better instruction. 


Summary 


_ The experience gained during the war in measuring achievement 
In enlisted training programs emphasizes the need to make test items 
Which measure functional knowledge. Probably naval instructors are 
More insistent than many in civilian education on the importance 
of Practicality in a given situation. Hence, in order to develop tests 
Which instructors will consider adequate and which will gain the 
respect of instructors and students alike, it is essential that the items 
reflect the functional aspects of the training program. Such test items 
should deal with actual procedures of sending or interpreting sig- 
Nals, Overhauling or adjusting equipment, analyzing casualties, or 
Operating and securing equipment. Whenever possible, the tests 
Should require the handling of real or model equipment, rather 
than talking about it. When this is not feasible, extensive use should 
* made of diagrams and pictures of equipment. 

he Program also gave convincing evidence that an important 
Outcome of the use of standard achievement tests may be to stimu- 
ae better training in enlisted schools. By testing jobs that were 
ee the jobs the trainee might m later billets, 
; emonstrated that training was not fulfilling certain of 
its Purposes. Instructors did not mean to be impractical, but they 
‘imply did not realize their impracticality until objective tests gave 
© evidence. After standardized tests were introduced, there was 
bim поте uniformity of training among parallel schools. Am- 
tried о differences of a eg | bun one 
satisfactor Struct objective tests. And in : process of developing 
cedures a tests, shop procedures were ER IH. and pro- 
ment of ee uon and overhaul were clarified, to the enlighten- 

E instructors and students. : 
Hon, py emt of achievement serves a somewhat different func- 
able, Ide ee gages help to make shop grades more depend- 
nize E = ification tests motivate trainees to understand or recog- 
ide variety of equipment. When broad coverage of theory 


е 5 J 
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and procedure is desired, the multiple-choice paper-pencil test 1s 
most efficient. Performance tests help to make sure that men can do 
jobs. Such tests stimulate a great deal of practical training even if 
only a few sample tests are given to each man. 

In general, the achievement testing program applied the best 
already-known methods to the rather new and unique situation 1n 
each enlisted school. Although much ingenuity was exercised in 
developing tests of military operations, it would be hard to demon- 
strate the invention of any techniques that had not been tried pre- 
viously in industry or educational institutions. The program did 
provide convincing evidence that objective methods of evaluation 


can be applied to practically any job, however complex or mechani- 
cal it may be. 


CHAPTER XVI 
ACHIEVEMENT EXAMINATIONS FOR OFFICER SCHOOLS 


THE problems of examination in the Navy’s schools for the training 
of officers were essentially the same as those in the enlisted training 
schools with the additional complications implied by (1) the wider 
range of subject matter to be covered and (2) the greater complexity 
of the concepts, principles, and procedures to be measured. The 
need for assistance to the schools in the development of objective 
and valid measures of achievement was early recognized by the Test 
and Research Section, but personnel were not available to accom- 
plish the task. To an even greater extent than was true in the en- 
listed schools, the officer schools were left on their own in the 
development of curricula and teaching materials. As schools of the 
Same general type were established in new locations, they tended 
to take over the practices of those which had been established earlier, 
adapting their programs to the facilities and equipment available in 
the new location and modifying the content and organization of the 
Instructional program in the light of the experiences and preferences 
of the administrative and instructional staffs. The necessity of shift- 
ing a small percentage of the trainees from one school to another 
forcefully directed the attention of the school authorities to these 
differences, and this in turn led to a healthy interchange of opinion 
as to the desirability of continuing or instituting certain units of 
Instruction and as to the relative value of different sequences and 
modes of presentation. The outcome of such interchange was a 
demand, originating in the schools, that standardized curricula be 
Provided and that some means other than the naked opinion of 
the training staffs be provided to estimate the relative effectiveness of 
the various programs. Р 
The staff of the typical wartime officer training school was made 
Up of officers drawn from three sources: (1) retired officers and regu- 
lar line Officers placed in a limited duty status, (2) reserve officers 
who were procured for teaching duty from positions in civilian 
Schools and colleges, and (3) recent graduates of the training schools 
Selected from the highest ten per cent of the graduating groups and 
eld over to guide and instruct the new incoming groups of trainees. 
he first and third of these groups were ordinarily unfamiliar with 
modern training methods, the second and third tended to be un- 
miliar with the Navy, and even the instructors drawn from civilian 
Schools found some difficulty in adapting themselves to the accel- 


erated pace and the emphasis on practice and procedure rather than 
315 
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theory and principle, which were characteristic of the training pro- 
grams. But all recognized the critical importance of their assigned 
mission and undertook to do the job to the best of their collective 
abilities within the limitations of time, facilities, and equipment 
available. 

In this climate of recognized need, efforts of the Bureau of Naval 
Personnel’s Training Activity to develop uniform curricula, to pro 
vide suitable uniform equipment and training aids for implementa- 
tion of the curricula, and to introduce objective and reliable meas- 


ures of achievement were assured the ready cooperation of the 
schools. 


Procedures Used in the Development of Examinations 


While the procedures used in the development of examinations 
for officer training programs were necessarily varied in order tO 
reflect the conditions, curricular content, and the number of dif- 
ferent types of schools, there was a uniform general pattern of test 
development. The first step in this procedure was to attempt 4 
definition of the objectives which the school's program was designe 
to attain in terms of the knowledges and skills which were to b^ 
expected of its graduates. This necessitated a review of the curricu- 
lum for the school, supplemented by examination of the specific 
courses of study and the schedules of class instruction and drill in 
effect at the various installations. This study of the objectives an 
actual curriculum culminated in the preparation of an examination 
outline which was submitted to the school or schools for criticism? 
and suggestions for revision. 

Following the development of an examination outline, or 5006, 
times concurrent with it, the work of assembling and preparing 
examination materials was undertaken. Usually the schools for 
which an examination was being prepared were asked to submit 
copies of the tests which they had already used with current aD 
previous classes, sometimes with samples of the answer sheets 01 
examination papers for statistical analysis. In addition to review 9 
the testing materials submitted by the schools themselves, the officer 
working on an examination studied the texts, reference materia 5 
and recommended films and Prepared examination items base 
upon these materials. From this stock of examination materials 
tentative forms of the proposed examination were compiled. nl 
cating the items to the headings of the examination outline i? ps 
portion to the relative weights assigned to these headings- 1m 
weights assigned were based on the am 


А the 
pas ount of time devoted 10 em 
treatment of each topic in the course of study and schedules: t 
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pered by the judgment of the instructors as to the relative impor- 
tance of the unit or topic. 

The tentative forms of the examination were submitted for criti- 
cism to various experts either in the schools, or in more advanced 
Specialized schools, or in the office or bureau of the Navy Depart- 
ment having cognizance over the content of the material. These 
fundamental questions affecting the validity of the tests were asked: 
(1) Is the information given in the item setting, and the keyed 
Tesponse, correct? (2) Are the decoy answers such that a person with- 
Out the correct knowledge would be equally likely to choose one of 
them? (8) Does the item as a whole require the application of knowl- 
edge or judgment that the graduate of this school should be ex- 
pected to have? (4) Has the information or concept necessary to give 
the correct answer to this item actually been taught in the school? 
(5) Does the whole examination provide a reasonably adequate rep- 
resentative sample of the desired outcomes of the course? 

. In addition to the review of the examination materials to elim- 
inate error and assure validity as to content, each item was scrutin- 
ized to discover extrinsic clues in the structure of the items, e.g. 
having the correct response indicated by its greater length or speci- 
ficity, or by the absence of grammatical or logical sequence in the 

Istractors. Items were also checked to avoid ambiguity and to assure 
the use of standard or conventional terminology. 

The Next step was the preparation of experimental forms of the 
Sxaminations, These were either in mimeographed or photo-offset 
reproduction, depending upon the size of the group to be used in 
cone perimental administration and upon the nature of the test 

Ei nt, especially taking into account the number and character 
ot illustrations used and the need for precise representation of 
Bures and diagrams. An officer of the Test and Research Section 
Was usually assigned to supervise the administration of the experi- 
mental forms in order to obtain first-hand data on such matters as 

) the amount of time that should be allowed for the examination 
Dri. (2) questions asked by the student-officers which should be 
se а revision of the directions, (3) specific items which the 
officers pa cers considered ambiguous, adr pecu of the student- 
Criticism, to the adequacy and fairness of the test, and (5) further 
served ~ and correction of the test content by the instructors who 
not ede ана E some instances преп ренин ~ who had 
With the е ме. seen t a RS p Bertha SE opm along 
of terminala ents in order to supply a fur check on correctness 

gy and content and absence of ambiguity. 
‘he results from the experimental administration of a test were 


su pa : 5 За за 
bjected to Statistical analysis to determine the reliability of the 


“ 
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test, and of the parts if separate part scores were indicated, to Сета 
the difficulty index of each item and to determine the — 
capacity of each item. Frequency distributions of the scores we 
made and the means and standard deviations computed. Where two 
or more forms of the examination were being prepared simulta- 
neously, these measures were used in determining the equivalence 
of the forms. The indices of difficulty and discriminative capacity 
were used in selecting items for inclusion in the final forms and 
as a means of spotting items which, despite all the precautions taken, 
proved to contain extrinsic clues or to be incorrect or ambiguous. . 
After final forms of an examination were prepared, a dern 
experimental administration was conducted in order to establish 
tentative norms. Generally the officer training schools adhered to 
the Navy's “4.0” grading system in which a grade of 2.5 is the lowest 
passing grade, 3.0 is average, and 4.0 the highest degree of attain- 
ment. Procedures for translating the raw scores on the examinations 
into this type of grade varied. In some cases an arbitrary decision was 
made as to what raw score on the examination should be equated 
to 2.5 representing the lowest passing mark. Similarly a raw score 
somewhere between the highest score attained and the highes 


: 3 А 
possible score on the test Was equated to 4.0. Intermediate score 
were then translated to gr 


than passing were comput 
equated the mean of the 
to be equated to 2.5 in te 
of the distribution. For example 


Types of Examinations Developed 
The examinations 
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The following example is taken from material for the Damage 
Control section of the examination for the reserve midshipmen's 
schools. 


The U.S.S. Flushing has the following characteristics: length 
560’; beam 55’; draft 16/5”; displacement 8,000 tons; waterline 
area 22,400 square feet; moment to alter trim 1" = 360 foot — 
tons; moment to heel 1° = 280 ton feet; GM = 3.75; BM = 
12.60’; KG = 15.80’. She is in condition II when a torpedo hit 
is suffered amidships. Eighty tons of flooding water are taken 
aboard in a waterline compartment on the second deck. The 
compartment, whose inboard bulkhead is 714’ from the C.L. of 
the ship, is 25’ long, 20’ wide, and 7’ high. 

The following series of problems, items 1 through 6, is based 
on the above information: 

l. The transverse free surface 5. The Flushing, after repair 
effect causes a reduction in of all previous damage, 


GM of 
1. 0.06’ 
2. 0.10" 
3. 0.55’ 
4.0.71 
5. 1.80 
2. The free communication ef- 
fect of the flooding water 
reduces GM by about 
1. 0.10’ 
2. 0.16’ 
3. 0.24" 
4. 0.33’ 
5. 0.55 
3. The tons-per-inch immer- 
Sion of the Flushing in sea 
water is 
l. 19.1 
2. 22.9 
3. 28.6 
4. 35.8 
5. 53.3 
· After the Flushing takes on 
105 tons of fuel oil from an 
Oiler at sea, her mean draft 


we" be increased by about 
" 1" 


2. 9" 
3. 3" 
4. 4" 
5. Бт 


takes a torpedo hit aft 
which puts 80’ of the water- 
line in free communication 
with the sea. The approxi- 
mate GM for the ship in 
the damaged condition is 
1. 1.80’ 

2. 1.95’ 

3. 3.21’ 

4. 3.49' 

5. 5.55! 


. The Flushing is 6" down by 


the head. There are 60 tons 
of fuel oil in a forward 
tank, which may be pumped 
into one of four tanks, A, 
B, C, or D, at points 30’, 
50’, 90’, and 180’ farther aft, 
respectively. To eliminate 
the 6” trim by the bow and 
cause her to ride with a 
slight drag, the oil must be 
pumped into tank 

1A 

2. B: 

3. С. 

4. D. 

5. None of these tanks. 


320 Achievement Examinations 


Another example of a series of test items requiring interpretation 
of technical data in a situation presented by diagram is drawn from 
the pre-radar field (Figure 1-ху). | 

A device which might be considered somewhat as an innovation 
in objective testing was used in the navigation section of the exam- 
ination for the reserve midshipmen’s schools. In this examination, 
the students were provided with a leaflet of excerpts from various 
publications such as the Nautical Almanac, Tide Tables, and Cur- 
rent Tables, and were instructed to bring with them certain basic 
reference materials, They were also provided with a chart on which 
to work out a series of problems simulating some of the elements of 
a navigator's day's work at sea. The first section of this test dealt 
with simple informational material. The second section required the 
use of the references to solve simple problems in nautical astronomy. 
The third section required the construction of a continuous пау“ 
gational plot from the data given. The latter two sections were 


weighted in scoring to compensate for the additional time require 


in locating data in the references, computation, and plotting. тле 
ninety minutes allowed for 33 


she А 5 
items comprising these sections Wa 
found to be none too much for the average midshipman. 


Use of the Examinations 


The examinations were designed to Serve as supplementary ipea 


udent achievement in the officer training 


d for the pre-radar schools and for the tactic 
radar school served that purpose. The exami 


- А To 
on and use of the instructional staffs- 
act that a standardized examination was 


ап 
= | 17 Instruction. In the case of the pre-radar а 
midshipmen’s schools, where there were several schools of the 52 


type using the examinations, it was assumed that there woul 
comparisons made from school to school and some degree of и 


| : ; ta 
was apparent even while the examinations were in the experime? 
stage. 


In addition to the us 
devices in the training 


pe 
ану 


“по 

satio 

efulness of the examinations as той ane? 
Program, they served three important 


LOW VOLTAGE POWER SUI 
400 VOLTS 


PPLY 
+ 


VOLTAGE 
POWER 
SUPPLY 


Items 1 
to the items below. 


l. In the 
9f the swe 


LR 
2. Ra 
3. Ка 
4. Ri 
5. Re 


2. In the 
creases to 


above diagram, the frequency 
ер can be changed by varying: 


above diagram, if -+400 V. de- 

à smal +150 V. and С, is replaced by 

800 fo capacitor, a sweep frequency of 

Swee SPs. is Р then possible. When the 

ade 15 again synchronized so that 2 

te ge Shown on the screen, the pat- 
Tn will appear as: 


(0 (2) (3) 


(4) (5) 


Figure | 


TIME CONSTANT OF RoCo 
VERY SMALL 
SCOPEPLATES SHOWN 
AS VIEWED FROM FRONT 


^ are based upon the above diagram. After examining the diagram, proceed 


3. In the above diagram, the oscilloscope 
is operating normally. If the Y input to 
a Dumont 208 oscilloscope with a prop- 
erly synchronized sweep is placed between 
the grid and cathode of the cathode-ray 
tube, the pattern on the screen of the 208 
tube will be: 


(1) (2) 


(4) (5) 


4. In the above diagram, assume that the 
input signal is removed and the sweep 
adjusted until the screen shows centered 
spot. If Rs is moved to the right, the 
screen will appear as: 


(1) (2) (3) 


GUO 


(3) 


“Xvi. Sample pencil and paper items in the Pre-Radar field. 
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tions in developing greater standardization of instruction and њи 
ding. The data presented below will illustrate the get 
made by certain of the examinations in bringing about (1) stan 4 
ardization of instruction in cases where the schools were establishe 
to serve the same training purposes, (2) a means of comparing ue 
performance of trainees in different schools or in different courses 
having the same general objectives, and (3) an improvement 1m 
grading and marking. г 
STANDARDIZATION OF INSTRUCTION. Training designed to prepare 
men for the Naval Training School (Radar) was established at pars 
pre-radar schools. The length of the pre-radar course was approx" 
mately four months. It was found that considerable lack ol pos 
formity existed in the preparatory training of men entering t^ 
radar school. Those selected for training at Pre-Radar Schools A an 
C were generally men with an engineering or electrical backgroun 


Ра Final 
Taste lxvi. Means and standard deviations for Pre-Radar = 
Achievement Examination—first administration of experimental form? 


Relia- Pre-Radar Pre-Radar ope 
bility Co- School A School B Schoot | 
Form Number efficients - -—————. c 
Number ofltems (CR! N M o N Mo NW M = 
= SS а 
1-х 70 68 60 466 60 56 471 67 98 428 19 
2x 110 85 59 804 108 71 769 119 43 716 12 
3-x 105 82 43 785 101 61 68.9 105 44 654 10.9 
4x 110 87 38 733 127 55 694 147 56 746 V 


1 Estimated by Kuder-Richardson Formula No. 21. ————— 


while those assigned to School B had simply a scientific background: 
School A's staff of instructors were all n RS 
for the job; those at Schools B and 
civilians. Most important, however, at 
of a standardized curriculum and stand 


for the pre-radar schools. A standard [o 
tion in August 19 


aval officers especially se! У 
С were, for the most P е е 
the outset, was the abse nt 
ard measures of achiever. 
urriculum was put in OP 


Е jeve 
44 and the development of standardized ach} 
ment examinations was initiated in October 1944. 


The data in Table 1-xvr show а marked trend toward equalization 
of mean scores for the classes graduating from the three per o 
schools. These data are drawn from results of the first admini ent 
tions of the experimental forms of the Pre-Radar Final Achieve" pe 
Examinations. In reading this table, comparisons should no um 
made between means on different forms of the test, since the Pwo 


ber of items per form and the distribution of items between Фе 
parts of each form were not the same. 
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COMPARING THE PERFORMANCE OF TRAINEES IN DIFFERENT SCHOOLS 
OR Courses. The use of a final achievement examination in com- 
paring the performance of individuals undergoing different courses 
of instruction is illustrated by the data in Table 2-xvr. These data 
are drawn from the results of administration of experimental Forms 
l and 2 of the CIC Final Achievement Examination to three pairs 
of groups at the Tactical Radar School. In each pair, the group 
marked with an L (5L, 6L, 7L) was made up of student officers who 
Were assigned to the school directly from midshipmen’s or indoc- 
trination schools. These groups received eight weeks of instruction. 
The groups marked with an S (6S, 75, 8S) were sea-experienced 
officers who took a four-week course of instruction. As shown by the 
data in the table, the student officers taking the longer course per- 
formed better, in terms of scores on the objective examination, than 
did the sea-experienced officers who took the shorter course. While 
these data do not provide an adequate basis to appraise the relative 
merits of the two courses, it can be seen that the longer course of 
Instruction resulted in a higher level of achievement than could be 
reached in a short course of four weeks, despite the fact that the 
latter groups had the initial advantage of sea experience. 

A further example of the use of the examinations to compare the 
Performance of students in different schools is presented in Table 
3-xv1. The data in this table are taken from the results of the experi- 
mental administration of the Reserve Midshipmen's Schools’ (Deck) 
Standardized Examination in two of the schools. In one of these 
Schools there were separate departments of Seamanship and of 

‘gineering and Damage Control. In the other, instruction in En- 
Bineering and Damage Control was carried on by the Seamanship 
Instructors during the last few weeks of the course. 

Tom these data it will readily be seen that, on the Engineering 
and Damage Control section, the performance of students in School 

Was markedly inferior to that of the group in School A. School A's 
Median score was higher than the scores obtained by 94 per cent 
Of the students in School B, and fewer than 10 per cent of the School 
- 8roup fell below the School B median. The difference between 
e two means is significant above the one per cent level. While the 

erence between the groups on the Seamanship section was not as 
и it was more striking in view of the fact that it had not been 
esol Ge School A’s median score on this test was higher than 
Schoo] ie percentile, while only 22 = cent of the group in 
siccae fy below School B's ме = ^. too, the difference 
med, € two means is significant above the one per cent level. 
ppears that the combination of Engineering and Damage 

trol with Seamanship as handled by School B not only resulted 


TABLE 2-xvi. Performance on the CIC Final Achievement Examination of student officers receiving eight weeks of 


instruction and sea-experienced officers receiving four weeks of instruction at Tactical Radar School 
—— E 


Distribution of Scores on CIC Final Achievement Examination 


ee 


Form X-1 Form X-2 
Class 6S Sea Class 7S Sea Class 8S Sea 
Class 51, Experienced Class 61, Experienced Class 7L Experienced 
Score Number Cumulative Number Cumulative Number Cumulative Number Cumulative Number Cumulative Number Cumulative 
Interval of Cases Percentage of Cases Percentage of Cases Percentage of Cases Percentage of Cases Percentage of Cases Percentage 
250-4 1 100 
245-9 
240-4 
235-9 4 100 1 99 
230-4 3 97 1 98 
225-9 4 95 9 97 1 100 1 100 
220-4 6 92 13 90 
215-9 8 87 15 80 1 96 1 99 
210-4 11 82 b 100 17 68 1 93 6 98 
205-9 П 74 1 97 12 54 2 89 4 94 
200-4 10 66 3 93 7 44 2 81 10 91 
195-9 15 57 2 83 14 39 3 74 10 83 1 100 
190-4 13 46 1 76 п 27 1 63 п 15 
185-9 13 9 3 712 6 19 2 59 14 66 2 96 
180-4 3 X 5 62 6 14 1 52 19 55 3 89 


768 
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in poorer achievement in the field of Engineering and Damage m 
trol but also detracted from student achievement as Me см та 
the examination at the end of the course in Seamanship. 


Taste 3-xvi. Performance of students in two Reserve a 
Schools on Parts 1 and 2 of the Reserve Midshipmen's Schools’ (Dec 
Standardized Examination 


Part 1—Seamanship Part 2—Engineering and Damage Control 


School A School В School A School B 
Num- Num- i Num- Num- js: 
ber Cumula- ber Cumula- ber Cumula- ber pa ont 
Score of tivePer- of tivePer- Score of tivePer- of tive s 
Interval Cases centage Cases centage Interval Cases centage Cases centage 
160-63 1 100 81-83 2 100 


156-59 

152-55 l 100 
148-51 3 99 
144-47 5 97 


78-80 4 99 
1 100 757 6 9 
1 99 72:74 19 9 
2 99 6971 12 g&o 9 
140-43 12 94 5 98 6668 90 78 2 99 
186-39 18 87 7 95 6365 96 6 7 

13235 21 78 17 92 6059 99 49 8 9 
128-31 21 | 65 19 83 5759 93 85 17 90 
0007 МО 17 74 Sabe в sj 7 8 
ОВО B m di i5 и SL а 


116-19 18 25 12 54 4850 7 в 35 53 
11215  9* 17 328 48 — 4547 2 3 17 35 
108-11 5 П 17 84 4244 3 2 25 26 
10407 з в 920 26  sg4i 0 М 
100-08 5 6 10 16 3638 15 9 
96-99 10 11 33:35 2 2 
9295 2 3 2 6 3039 
8891] 2 | 6 5 97.99 1 ] 
84-87 3 2 
80-83 
76-79 1 1 
Q, 135 128 67 55 
Md 127 117 63 50 
Q, 120 107 57 44 
Mean 126.3 117.2 62.5 49.8 
: 12.21 14.40 8.16 195 


difference might be explained by differences in the abilities of Фе 
groups of students in the two schools were it not for the fact that © 
the remaining sections of the examination, Navigation, and О? 
nance and Gunnery, such differences did not appear. 
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IMPROVEMENT IN GRADING AND MARKING. Two types of evidence 
indicate the improvement in grading and marking which resulted 
from the introduction of final achievement examinations in the 
Tactical Radar School: (1) the interrelationship between various 
grades before and after the introduction of the tests, and (2) the 
increased efficiency of prediction of school success when the final 
achievement examination grades are used as a criterion or as a factor 

‘in the criterion. 

The final course grades for the first three classes completing the 
course of the Tactical Radar School consisted of the weighted 
average of the “theory” and “practical” grades assigned each student. 
The “theory” grade, contributing one-third to the final average 
grade, consisted of the arithmetical average of all grades received 
in weekly quizzes. The "practical" grade was based upon ratings of 
the student’s performance in the Combat Information Center mock- 
up. Original ratings were made on a scale ranging from 1, high, 


TABLE 4-хут, Intercorrelations among grades comprising the Final School 
Grade for the fifth class at the Tactical Radar School 


— 
Achievement Theory Practical 
Examination Grade Grade Grade 
Theory Grade 59 
Practical Grade ЛІ 18 
Final School Grade! .80 89 31 


" This grade is the arithmetic average of the other three; therefore the correlation ^ 
efficients in this row are spuriously high. 


to 5, low, on the traits of (1) leadership, (2) teamwork, (3) judgment, 
mental agility, (5) surface plotting, (6) air plotting, and (7) 
Speech. After combination, these ratings were converted to grades 
€xpressed in terms of the Navy “4.0” system. These "practical" 
&rades made up the other two-thirds of the final average grade. For 
the fourth and fifth classes the results of the final achievement 
€xamination were introduced in the final grades. The students’ 
Scores on the CIC Final Achievement Examination were converted 
into Navy “4.0” grades and these were averaged together with the 
cory” and “practical” grades which were determined in the same 
Manner as with the previous classes, each of the three grades being 
Siven a nominal weight of one. 
Р Һе interrelationships of the grades used in computing the final 
1 њу grades for the fifth class are shown in Table 4-xvr. Particu- 
arly Striking in Table 4-хуг are the low correlation coefficients 
a the "practical" grade and both the "theory" grade and the 
C'levement examination results. 
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It should be remembered that the “practical” grade consists of 
the ratings which were made of the student-officer's performance s 
the Combat Information Center mock-up. While one would no 
expect a perfect correlation between such a measure and perform- 
ance in class work, it does not seem reasonable that the relationship 
should be as low as that shown in this table. If knowledge about a 
subject contributes to performance, one would expect the SE. 
ship to be higher, since the "practical" grade and the pig arc 
ratings purport to evaluate the officer's performance in a ee 
Information Center, and the development of competence in such 
performance was the general objective of the entire training pro 
gram of this school. А 3 

The final school grades for classes seven, eight, and nine wer 
somewhat differently derived. The “theory” grade was based apoi 
the course grades for the first four weeks. The “practical” grade 


Р inal 
TABLE 5-xvi. Intercorrelations among the grades comprising the Fina 
School Grade for the ninth class at the "Tactical Radar School. 

(№ —117) 


MEL a 


Achievement First = 
Examination Month Mon 


Grade Grade Grad? 
First Month Grade (Theory) 


-78 
Second a Grade (Practical) 66 69 
Final School Grade (Average) 1 91 -93 84 


1 This grade is the arithm 


ation 
coefficients in this row are Sp 


etic average of the other three; therefore the correl? 


uriously high, 


The data in Table 5-хут, 
4-xvi, indicate that the el 


> : ig 
mation Center mock-up, which had 079 


-thirds of the final grades, resulted i 
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would expect correlations between different measures of success to 
be. Apparently the introduction of the final achievement examina- 
tion and the comprehensive practical examination brought about 
a better definition of the criterion of success to be employed at the 
Tactical Radar School, as evidenced by these higher interrelation- 
ships among the grades making up the final grade assigned to each 
student. 

IMPROVEMENT IN THE EFFICIENCY OF PREDICTION. Increased effi- 
ciency in prediction of school success, an important element in the 
reduction of attrition, is indicated by the data in Table 6-хуг which 
compares the correlation coefficients between scores on parts of the 
Officer Classification Test and the grades of students before and 
after the introduction of the achievement examinations. 

For class three, the only relationship which attains the five per 
Cent level of significance is that between Part I—Verbal Section of 


TABLE 6-xvr, Correlation coefficients between scores on the Officer Classi- 
cation Test and criterion measures at the Tactical Radar School, for 
classes on which the bases of grading differed 


— 
Classes 7, 8,9, № = 88 
Class 3, N = 178 
Achievement 
Officer Classification Theory Practical Final Examination Final 
Test Part Grade Grade Grade Grade Grade 
I Verbal 16 13 18 1 .32 
II Mechanical —.06 07 04 .30 19 
ПІ Mathematical 07 —.04 01 44 49 
Spatial —.09 01 —.02 13 .08 


the Officer Classification Test and the final school grade. For classes 
seven, eight, and nine, the correlation coefficients of both the Verbal 
€ction and Mathematical Section of the Officer Classification Test 
With both final school grade and achievement examination are well 
above the one per cent level of significance. It is also to be noted 
at the correlations with the achievement examination are generally 
Somewhat higher than those with the final school grade. That this 
Mprovement in prediction is not merely a statistical artifact is indi- 
B by the changed pattern of relationships. The most striking 
act is the high relationship between the Mathematical Section of the 
ae Classification Test and both the achievement examination 
е and the final school grade. Evidently the introduction of the 
nal achievement examination resulted in a greater emphasis being 
Placed on the technical and navigational phases of the curriculum. 
hether the final grade which resulted from the use of the new 
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"T m- 
grading factors, including the achievement сване ави emt 
inating the ratings, constituted a more valid си па о кеј er 
of student officers is of course a different question. It ce У dt oe 
however, that the new criterion was predictable by Y m inpol 
Officer Classification Test whereas the old one was not. It 1 


-riterion 
tant to note that in the judgment of the school staff the new cr 
was superior to the old one. 


The Future of Achievement Tests for Officer Schools 


а acer 

Much of the material prepared for use in the wartime ben 
training schools will prove useful in the officer training Pination 
of the post-war Navy. Present plans indicate that an d pe 
program for the Naval Reserve Officer Training Corps units dopte 
developed when the standard curriculum for the NROTC is ds ог 
and put into operation. A series of tests is now in prepar ion 
use in the graduate general line school which is to provide add ointe 
training for the reserve and temporary officers who will be ok 
to commissions in the regular Navy. It is also expected th 


ose 
examination materials, modified and augmented for the Wet 
will be made a part of the examination stockpile from which 
inations for promotion are prepared, РЕР 
Іп а ѕепѕе, (Һе examinations developed for the officer training 
grams during the war 


5 lica? 
can be considered the fragmentary apP pee? 
of principles and tech 


pro 


nty 
developed in American colleges and universities over the past e late 
years. Even though the examination program was developed t0? nt 
in the war to demonstrate the full potential utility of measure rs, 
in the evaluation and control of the training programs for 9 5g 
enough of a start was made to indicate the need for a cont! cc 
program of researc 


future emer 


gency may raise and defin 
Gunfire 


e. 
Can be most effectiv 


CHAPTER XVII 


THE MEASUREMENT OF ACHIEVEMENT IN THE RADIO 
TECHNICIAN TRAINING PROGRAM 


THE Navy programs for training enlisted personnel to operate and 
maintain electronic equipment have paralleled the phenomenal 
development of various types of radio, radar, sonar, fire control, and 
related gear. Before the war, when the uses of radio and related 
electronics gear were considerably less developed, the majority of 
Daval radiomen were assigned to routine communications duty. 
Upkeep of the electronic equipment was the responsibility of the 
chief and first class petty officers (radiomen) who were graduates of 
the single Radio Materiel School or who had shown a special apti- 
tude for maintenance work. 

As early as 1928, however, communications personnel in the fleet 
had become increasingly aware of the necessity for training men 
Specifically to maintain and repair the operating equipment. By 

39, it was clearly apparent, not only in the fleet but also in the 
Cognizant bureaus, that thousands of men (later designated as radio 
technicians and more recently as electronic technician’s mates) were 
needed to service the equipment which was multiplying in variety 
and becoming increasingly complex. Between 1939 and 1941, plans 
d augmenting the training programs Were underway and a build- 
cir. bn was initiated. In December 1941, classes averaging 75 
m Were entering the training program every two weeks. The 
ime demand for personnel to be trained to meet the main- 
al ru needs of a rapidly expanding fleet, coming at the time when 
expa a personnel programs of the Army, Navy, and industry were 

"s. ing, gave rise to a number of problems. 

- the РКОВГЕМ oF SELECTION. Before and during the early months 
а : war, only men who had some previous background in radio 
Sma work were accepted for training as maintenance per- 
Progra, ut as a result of war pressures, personnel input quotas to the 
" nin were increased. One immediate result was the exhaustion 
selecting Re, of experienced men and ihe ene necessity of 

"ви tea rini from the са orien gl. ation large num- 
ability maps ose acquaintance with radio " y stopped with the 
Programs re on and off a home receiver a to tune in desired 
selected E S selection standards were lowered, many of the men 
пева unable to maintain the pace of the intensive and 

Program. The rate of attrition became very high. Im- 
331 


332 Achievement Examinations 


proved selection instruments and procedures were urgently needed 
to identify among the available men those who, when trained, would 
be most serviceable to the Navy. This led to the development of 
the Radio Technician Selection Test which has been described in 
Chapter VIII. 

THE PROBLEM OF TRAINING. Furthermore, it was found that many 
of the capable men did not have the background in mathematics, 
engineering, and electricity required for successful completion of the 
course of instruction in Radio Materiel school. To supply this back- 
ground, two types of preparatory schools were established. The first 
of these was known as the Elementary Electricity and Radio Materiel 
(EE and RM) schools. As the program expanded and as the 10 
duction of inexperienced personnel increased, schools of this level 
were also found to be inadequate to supply all the necessary ele 
mentary training. Therefore, the one-month Pre-Radio-Materie 
schools were established on the preliminary level. The training prO" 
gram as thus organized, consisted of three levels of schools, Pre- 
Radio-Materiel, EE and RM, and Radio Materiel, covering a tot? 
period of eleven months. 

During the course of instruction in Pre-Radio-Materiel schools 
an attempt was made to give men of very different backgrounds а 
basic knowledge of certain elementary concepts of mathematics an 
electricity believed essential for successful performance in EE an 
RM schools. In large measure this program consisted of intensive 
review of high school mathematics and physics. 

Graduates of the Pre-Radio-Materiel schools were sent to E 
RM schools for three months of classroom and laboratory training 
in mathematics, electricity, rotating machinery, and radio theory: 
This curriculum represented new learning for almost all trainees — 

Graduates of the EE and RM schools were then considered p 
pared to undertake the study of Navy electronic equipment as taug? 
in the seven-month advanced course at Radio Materiel schools- 

With a great increase in the length and volume of radio tech? 


cian training, standardization of the program became a problem 
major importance. 


Е and 


The Improvement of Training 


In December 1943, plans were made to double the input of e 
to the radio materiel training program; and subsequently, as needs e 
new schools were opened. A large number of thee were 8i th 
second level (EE and RM), and of these more than half were aet 
in civilian colleges and engineering or technical schools unde” о 

tract with the Navy. 
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Navy equipment was continuously subjected to objective and 
closely controlled tests to establish the superiority of one piece of 
gear over another; but in the field of personnel, little evaluation of 
training of radio technicians had been made beyond the pragmatic 
observation that, in general, the type of training being received in 
existing Navy schools appeared to be adequate. Therefore, with the 
€xpansion of training, the new contract schools were given an out- 
line (often meager) of what the existing program had been in the 
Navy schools. From this the school faculties were expected to formu- 
late a curriculum covering the fundamental concepts of electricity 
and radio. 

It is readily understandable that the variety of programs thus 
developed in these contract schools resulted in a non-uniform type of 
graduate, a constant source of trouble in subsequent training. In- 
evitably, the first month of instruction in the advanced schools had 
to be spent in review and even first teaching of certain fundamentals 
in order to make sure that each man had the necessary preparation 
to undertake the advanced curriculum. 

Because of this lack of uniformity in school graduates, the Elec- 
tronics Section and the Test and Research Section of the Bureau of 

aval Personnel early in 1944 undertook jointly to set up a compre- 
hensive standardization program for the Pre-Radio-Materiel and 
EE and RM schools. Previous curriculum studies were reviewed, 
Practices of the existing schools were examined, and the needs of the 
рчы schools were analyzed. The curricula and laboratory out- 
fee ог the Pre-Radio-Materiel and EE and RM schools were pre- 

ed and placed in operation in March 1944. 

N as had been a long tradition of much mathematics in the 
mur d training program. Most of this content was concen- 
t Corato the EE and RM schools and was presumably necessary 
ical background required for success 1n the advanced schools. 

the Е the training program became more and more concentrated, 
Meme of much of the mathematics taught was frequently 
Но ме Considerable opposition, based on the opinions of in- 
includi and on reports from the fleet, developed to the practice of 
Special E a much mathematical material in the curriculum. One 
the Gener y was carried out to obtain a more objective picture of 
schools T and extent of mathematics required by the advanced 
cdl comas : provide specific information, a check list of mathemati- 
of the Ma dps prepared and submitted to the instructional staffs 
Possible e 5. From the combined reactions of the instructors it was 
the EE and recommend that certain large areas of mathematics in 
could well RM curriculum could be omitted entirely, while others 
receive less emphasis. The ensuing changes caused no 
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е 
perceptible lessening of trainee quality. As a matter of tim al 
was a subsequent marked trend toward increased practica 
curriculum even in the advanced schools. -— 

THE DEVELOPMENT OF ACHIEVEMENT EXAMINATIONS. Two i io 
of standardized final achievement examinations were develope abs 
implement the new Pre-Radio-Materiel and EE and RM dec іё 
From the beginning, these examinations were regarded as an now 
gral part of the training program. It was felt that no matter dio- 
detailed the curricular outlines and syllabi might be, the rms aot 
Materiel and the EE and RM schools could also get direct lea md 
to the type of preparatory training the advanced schools m: the 
necessary from the examination hurdles set for the graduates w^ ons 
two preparatory schools. To this end each series of examina the 
was carefully designed to sample in a comprehensive manner 
entire content of the respective curricula. hools 

Specifically, the aims of achievement examinations in these SC 
may be stated as follows: serve 

1. To direct instruction toward curricular objectives and to 
as a basis for necessary changes in the courses of study. 

2. To check on adequacy and quality of instruction. 

3. To supply an objective and comparable measure of 


ment of individual trainees, classes, and schools. 


Á : : o inaptitude 
4. To provide a final test mark as a basis for declaring aaa oe 
for holding over for furthe 


r instruction, or for graduating 17а 
to the next phase of the program. 
Pre-Radio-Materiel Achievement Examinations. Six forms 0 ted- 
Pre-Radio-Materiel Achievement Examinations were construc" 
These tests consist of fi 


- де 
с Our-response items. Forms 3-6 are j5 items 
of 100 items each, distrib zs 


uted as follows: Mathematics, 35 tng 
Electricity, 50 items; 


к а А es 
and Mechanical Practice, 15 items. T hes 
time is two and one-half hours. 


The dispersion of scores ОП ^ те 
tests is uniformly narrow and the means are uniformly 115 ts in 
flecting the fact that the Pre-Radio-Materiel curriculum consi ave 
large measure of intensive review and that the examinations 
been devised to measure minimum essentials, ligi 

Insofar as possible, items were developed at the level of apP the 
tion of princi 


Ples to practical problems, but since much 9 uch 
learning in Pre-Radio-Materiel schools is at the vocabulary leve’ еті" 
functional items have not always been practicable. Some ä 
mentation was done with items of this type: 


achiev 


f the 


Directions: 


In each of the two foll 


А | be per 
н Owing exercises, the five steps to 
formed in an operati 


ће 
on are arranged in mixed order. Mark * 
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numbered answer spaces on the answer sheet to indicate the 
order number from 1 to 5 in which each step should be per- 
formed. In the sample below, b is step 1, d is step 2, etc. 


Answer Form 
SAMPLE Steps 
Steps in a soldering operation 


a. Tin and clean the soldering iron 

b. Complete the work to be soldered 

c. Begin heating the soldering iron 

d. Select an iron appropriate for the job 
e. Apply heated solder to the joint 


71-75. Steps in a drilling operation (Use spaces 71-75 on Answer 
Sheet): 


71. Center drill in chuck and tighten 

72. Determine size and location of hole to be made 
73. Obtain drill of proper size 

74. Center-punch proposed hole 

75. Fasten on support material to be drilled 


76-80). Steps in soldering wire to а smooth surface (Use spaces 
76-80 on Answer Sheet): 


76. Turn off heating current 

77. Hold wire on plate, apply heat, and solder 

78. Push back insulation and clean surface to be soldered 
79. Remove iron and hold connection rigid 

80. Plug iron into receptacle to allow to heat 


E zn hoped that understanding of correct procedures could thus 
а Subsequent experience showed, however, that such 
shane were subject to many ambiguities, since in many operations 
shes 1$ no single proper sequence. When such items were con- 
Te ve free from ambiguity, it was generally found that they had 
in heir discriminatory power. Although these items failed in their 
oe purpose, they did call the attention of instructors to the 
pons instructional emphasis upon a single acceptable order of 
might id where, in a given situation, several different Sequences 
EE е equally correct. E Р 
the E RM Final Achievement Examinations. 'The six forms of 
соте e аСіечешеві examination for the EE and RM schools were 
ed to sample trainee learning in the following areas: 


Part I. Applied Mathematics, Fundamentals of Electricity, 

Р Fundamentals of Radio. 

art II. Communications Circuits, Power Supplies, Electri- 
cal Machinery, Fundamentals of Radio. 
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Part I (40 items in Form 1 Revised, 50 items in Forms 2-6 ints 
yields a single raw score, Part II (80 items) yields four raw scor 
facilitate diagnostic evaluation of the student's work, — 
Since the emphasis in the curriculum at this level is on the иёс 
opment of understanding of fundamentals, it was felt that the зре а 
factor should be minimized in the determination of examimano 
scores. The time limit of three hours for each part was a 
through a series of experimental administrations to determine thi 
limit within which nearly all men could finish the SENATE tt 
All test items are of the five-response multiple-choice type. ж 
effort has been made to sample the trainee's ability to apply theor! " 
ical principles to the solution of practical problems. For examp'e 
the curriculum for the first and second months of the EE and 5 
school stresses the mathematics necessary for understanding t 


М Эе ће 
various characteristics and phenomena of altern 


$ " 

ating current. 1 
test items in the examination, while essentially electrical in conten 
have been devised so as to sam 


= eal 
ple practically all of the mathematica 
skills which the EE and RM 


the 
graduate should have mastered as 
basis for advanced school studies. 


Throughout the examinations, 
problems which demand the abili 
learned. Typical diagrams and scl 
encountered when servicin 
items based on such schem 
of faulty operation, the 
result from various typi 


the emphasis has been placed = 
ty to reason in terms of the be 
лета св, such as will actually st 
8 gear aboard ship, are employed. ses 
atics include the location of typical сач nt 
prediction of faulty operation which pc 
cal equipment failures, and the like. e 
problems are believed to approximate fairly closely both the anm 
kinds of situations which might be encountered aboard ship, 2 
the types of reasoning demanded for their solution. 

Statistical treatment of each form of the EE and RM F 
Achievement Examination has included determination of: 

estimated item-test coefficients of correlation, 

difficulty values, 
Kuder-Richardson reliability coefficients, 
part-whole and interpart correlation coefficients, 
validity coefficients, 
. norms. 


Table 1-хуп shows the avera 
difficulty values, and reliabil 


inal 


9 o gon 


Jor 
á Я jent 
8€ item-test correlation coeffic 


$ Р : pile 
ity coefficients for the six forms. УУ, 


Ne А 2 in Chap 
the reliability coefficients are not as high as those reported in ra 
ter VIII for the Radio Technician Selection Test, it is believe the 
they are satisfactory, 


particularly in view of (1) the tendency 9 pat 
Kuder-Richardson formula to underestimate, and (2) the fact oh 


. B B . ee е 
the tests are given under no time-limit conditions. Items іп 
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form have been selected to provide a good range of difficulty values. 
At the outset are placed items which are solved by 90 to 100 per 
cent of the men. As a rule, approximately two-thirds of the items on 
each form are answered correctly by 50 per cent or more of the men. 
Only a few items are missed by as many as 75 per cent of the trainees. 
Despite the generous time limits for administration, all forms yield 
essentially symmetrical bell-shaped distributions of scores. 

To determine the validity of the part-score breakdown of Part II 
Of these examinations, interpart and part-whole correlation coeffi- 
cients were computed for each form. Typical of the results are the 
data for Form 6 as shown in Table 2-xvit. It will be observed that 


TABLE 1-хүп. Reliability coefficients, average item-test correlation co- 
efficients, and average difficulty values for EE and RM Final Achievement 


Examination 
Item Analysis Data 
Average Index of © 
Reliability Data Item-Test Average 
Form Number Correlation Difficulty 
Number ofItems N r(K-R)! M с Coefficient ? Value’ 
l Revised 120 900  .85 95.69 11.27 .36 54.3 
2 130 9200 .84 100.83 11.49 34 76.5 
8 180 900 .86 106.98 11.34 .88 81.5 
1 1380 9200 .87 98.65 13.90 42 73.8 
5 130 9200  .87 99.83 12.99 .39 76.4 
6 130 464  .87 96.38 13.67 40 77.7 


1 
2 Сотршеа by Kuder-Richardson Formula No. 21. 

ad tem-test correlation coefficients estimated from upper and lower 27% of the test 
re distribution, Flanagan, J. C., “General Considerations in the Selection of Test 


15, etc." J. Educ. Psych., 1939, 30, 674-680. 


3 Index di sons i ect respo) 
of i fi rsons selecting the corr n: 
the j à ifficulty is defined as per cent of per g sponse to 


bos Interpart coefficients of correlation are consistently low when 
: 'sidered in relation to the part-whole coefficients. Thus the use 
Part scores appears to be warranted. 
for qe ey indicated, the EE and RM schools are preparatory 
bie work of the Radio Materiel schools. The EE and RM Final 
Б ne Examination has been established as the criterion for 
fheasure fe pass-fail marks in EE and RM school. Therefore, a 
ke Da С the validity of these examinations 15 the extent to which 
с oe ict achievement in the third-level Radio Materiel schools. 
e к Iu presents correlation coefficients between scores on four 
iba the EE and RM Final Achievement Examination and 
S 1n the first month of Radio Materiel school. These coefficients 


fo 
m; 
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are within the limits usually considered satisfactory for educational 
prediction. - 

Form 1 Revised, the only form available, was administered to 
classes graduating during the period June 23 to September 27, 1944. 
Because the scores increased steadily it was suggested that this form 
had probably been compromised by student gossip and by direct 


TABLE 2-хуп. Part-whole and interpart correlation coefficients for EE 
and RM Final Achievement Examination, Form 6 (N — 200) 


т Total PartI PartIl Па IIb IIc па 
Part I 86 50 

Part II 88 

Па .64 32 E 40 
IIb .63 .32 438 
IIc 52 .88 
па 73 

. Possible Maximum 
Score 130 50 80 25 20 10 25 

Mean 106.96 39.37 67.50 20.88 17.53 8,90 20.32 
S 914 473 571 295 180 199 242 


TABLE 3-хУП. 


Correlation. coefficients between scores on EE and RM 
Final Achieve 


ment Examination and marks at end of first month of 
Radio Material School 


EE and RM Final Achievement Examination 


Form 1 Revised Form 2 Form 3 Form 4 
Forms Бога 4 
School T N T N T N T N 
x 38 293 52 278 58 998 65 817 
Y 49 208 54 901 54. 175 60 203 
2 52 177 59 184 69 170 70 198 
Averager! .47 55 59 65 


1 The average correlation coefficient is determined from the weigh Peter? 
ted z values. 
C. C., and Van Voorhis, W. R., Statisti Ба 


cal Procedures and Thei atical Bases: 
New York: McGraw-Hill Book С ^ eir Mathem 


ompany, Inc., 1940, Р”. 155. 
instruction for the examination. 
available, Forms ? and 8 were ad. 
12 and 26 respectively, On Nov 
administered; the scores on thi 
tive improvement. The steady 
Revised, which continued afte 


"Therefore as soon as they became 
ministered to the classes of Octobe 
ember 8, Form 1 Revised was agai” 
s administration still indicated розе 
upward trend of scores on Form А 
т additional forms intervened, ha 
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been interpreted to mean that instruction has been directed toward 
curriculum objectives and that loss of security of examination con- 
tents has been negligible (Figure 1-хүп). 

, It has been possible to trace directly the effects of these examina- 
tions upon the instructional program. With the passage of time, item 
difficulty values tended to decrease in critical areas of subject matter. 
Numerous reports were received from school officials indicating that 
the examinations provided them with guide posts which enabled 
them to interpret the curriculum more fully. The sampling of 
instructional material represented in the examinations is so com- 
plete that if schools do teach for the examinations, they will of 


TEST SCORES 


30 40 so 60 70 80 90 мо 10 120 


Date of Administration. July 6th, August 2nd, September 13th, November 8th. 


A a bar = score area covered by middle 50% of men. 
F X line within bar = school average. 
У X—X = highest and lowest score. 


Figure lxvi. Grou gains in scores on EE and RM Final Achievement 
Xaminations, Form 1 Revised (Forms 2 and 3 of t his examination were 
administered to classes graduating October 12th and 26th, 1944). 


necessity teach the desired materials with the intended functional- 
Practical emphasis. 

; Perhaps the most convincing evidence of the standardization and 
improvement accomplished through the construction of stand- 
ardized curricula and examinations came from the reports of the 
advanced schools. They were no longer able to identify men by the 
EE and RM schools attended because their skills were so uniform 
that the former individual school training peculiarities had disap- 
Peared; furthermore, achievement of the trainees improved suffi- 
Clently to eliminate the need for extensive review in the first month 
Of advanced school and to permit the immediate undertaking of 
advanced instruction. 
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EE and RM Performance Tests. A project for developing com- 
prehensive performance tests for the measurement of laboratory 
skills in the EE and RM schools was initiated early in 1945. The 
procedure followed in the formulation of these tests is similar to that 
described in Chapter XV. Representatives of the Test and Research 
Section visited each of the schools and assisted the local staffs in 
determining the appropriate tasks and skills to be measured and the 
possible techniques for evaluating performance. As a consequence, 
each of the schools undertook the development of experimental 
forms of laboratory performance test items which they incorporated 
as an integral part of their laboratory program. 

In July a conference was called at the Bureau of Naval Personnel 
for coordinating this program. Technical officers of each of the EE 
and RM schools met with representatives of the Test and Research 
Section and other cognizant sections of the Bureau of Naval Per- 
sonnel. The whole philosophy of performance testing was reviewed 
and discussed. Sample items developed by individual technical offi- 
cers were analyzed for relative strengths and weaknesses. Following 
à survey of the curriculum, decisions were reached regarding the 
number of performance tests to be developed and the areas of the 
curriculum to be covered by each. Responsibility for the develop- 
ment of performance tests covering specific areas of the curriculum 


was delegated to each of the technical officers present. 'These projects 
were well underway when the surrender of Japan and subsequent 
separation of many of the technical officers brought a temporary 
suspension to this program. 


Rating Scales for Instructor Training 


Throughout the war the radio technicia 
its own instructor training school. Selecte 
vanced schools were given an eight-weeks с 
and materials, and upon the completion о 
to instructional duties in the EE and RM 
were developed for use in this program. 

THE TEACHER TRAINEE RATING SCALE. This scale was developed 
for the use of the supervising teachers in estimating the efficiency 9 
the teacher trainees during their practice teaching period. It con 
sists of twenty items considered by supervisors in the instructor trai" 
ing school to be essential to good teaching. Examples are: knowledge 
of material; organization of material; reaction of class to 16001 
ability to handle questions; maintenance of schedule; use and choi 
of visual aids; poise; discipline of and relation to students. Бас а 
item is followed by five descriptive phrases, one of which is to P 


п training program had 
d graduates from the ad- 
ourse in teaching methods 
f this course were assigne 

schools. Two rating scales 


Training Radio Technicians 341 


checked as being most descriptive of the trainee being rated. А рог- 
поп of the scale is shown below: 


Directions: For each item check that statement which, in your 


=A 


== 
= 4; 


—Ee. 


—е. 


opinion, most nearly fits the above man at the time 
of this report. 


Knowledge of material: 


prepared; knowledge adequate 

poorly prepared; sometimes stumbles over material 

has knowledge of complex material; sometimes speaks 
above understanding level of students 

knows complex material; presents work clearly; easy to 
understand 

unprepared; knowledge inadequate 


Organization of material: 


- fairly well organized; some novel planning 
- organized for most effective presentation 


incompletely adequate; slipshod 


- organization adequate; conventional 


disorganized; confused 


Reaction of class to lecture: 


- interest fluctuates 
- bored, restive, disinterested 


shows lack of interest 


- engrossed, attentive, interested 
- Shows unusual absorption 


Ability to handle questions: 


: comprehends rapidly; gives answers; proceeds on course 
- not disturbed; answers lengthy and indirect 
- Stimulates questions; answers effectively; does not leave 


main course 


- disturbed by questions; leaves main course 


disturbed at first; regains poise and proceeds on course 


During the course each trainee was observed and rated at least 
Once а week, after which the supervisor discussed his ratings with 
him. Then on a self-keying profile the trainee plotted the ratings 

€ was given; he was thus enabled to evaluate his progress from week 


to week, 


The final assessment of the trainee's potential quality as an in- 
Structor was based on his status at the end of the course, on the 
assumption that his worth to the program was best represented by 


15 fina] 


Status rather than by an average which might reflect his 
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beginning inexperience. Although all of the instructor trainees 
showed improvement on this scale during their eight-weeks training 
program, the previously experienced groups attained maximum 
level earlier and on the whole were superior to the previously inex- 
perienced groups. This is of course a natural expectation, зиме 
previous experience in teaching probably reflects a higher degree 
of interest in, and aptitude for, teaching. 

Tue Instructor RATING SCALE. The Instructor Rating Scale was 
constructed for use as a supervisory instrument in evaluating the 
quality of teachers in the EE and RM schools of the program. Ten 
Aspects of teaching were selected, and a series of questions relating 


to each of these aspects was checked by the rater on a five-point scale. 
Sample items follow: 


Directions: Under each of the following ten headings are ques- 
tions suggesting some types of skills which should be con- 
sidered in evaluating teaching efficiency. Read the sample ques- 
tions under each heading. Then place a check (\/) in the box 
under each heading which indicates your judgment of the 
quality of work being done by the above-named instructor. In 
making your judgment on a particular item, disregard every 
other item. Do not attempt to mark each of the sub-questions 
individually. Your mark should represent your judgment of the 
man's overall performance under each heading. 


1. Lecture 


How effective is he in getting his ideas across to students? 


Does he make main points stand out? Are his lectures clear- 
cut and easy to follow? Does he define new terms when pre- 


senting them? Does he check student understanding during 
a lecture? Does he speak effectively? 


unsatisfactory ^ just passable 


[] [- 


2.0 2.5 3.0 
2. Laboratory 


average good superior 


3.5 4.0 


How effective is he in directing laboratory work? 


Does he keep students working efficiently throughout entire 
period? Is class production high? Does he have equipment 
ready for class use? Does he check equipment before use 
and keep it in good repair? 


unsatisfactory ^ just passable average good superior 


2.0 25 3.0 3.5 4.0 
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Summary 


, Coordination of effort has characterized the program for the selec- 
tion and training of Navy radio technicians. The Test and Research 
Section has worked closely with Curriculum, Instructor Training, 
and Electronics Sections, with Training Aids Division of the Train- 
ing Activity, and with the Classification Section of Enlisted Per- 
sonnel Activity, in the development of selection and achievement 
tests, in the determination of selection procedures and standards, 
and in the development of curricular and training aids. This close 
cooperation of the various programs within the Bureau of Naval 
Personnel, working together with the staffs in the schools, has con- 
tributed greatly to the successful training of thousands of radio 


technicians for the Navy. 


CHAPTER XVIII 
ADVANCEMENT IN RATING EXAMINATIONS 


As indicated in Chapter V, the standards for petty officer rating mE 
advancement of enlisted personnel are established by the Bureau o 
Naval Personnel. All petty officers are expected to qualify in certain 
“petty officer qualities” and to possess the fundamental knowledge 
required of all men in the Navy. In addition, each petty officer 15 
expected to meet the technical qualifications of his specialty. These 
technical qualifications are standard for each rate (pay grade) within 
the rating. А 

To illustrate the nature of the qualifications specified for a rating 
there are listed below the specific standards which must be mek 
before a man is rated radio technician third class. Before a man 5 
advanced to radio technician second class he needs to be more expert 
both in practical matters and in examination subjects. A radio tech- 
nician first class must meet still more technical standards, while (0 
be rated chief radio technician, in addition to completing practica 
on the job training, a man is expected to have graduated from Hr 
advanced radio materiel school approved by the Bureau of etm 
Personnel. The studies of a chief radio technician are so technica 
that it is unlikely that he would develop the necessary competence 
solely through shipboard or shore station training. 
Qualifications for Radio Technician Third Class 

A. Practical Factors 


l. Primary Factors (Petty Officer Qualities) 
(a) Leadership. Demonstrate the qualities of a good leader 


when in charge of a group of men. Demonstrate ability to 
train subordinates. 


(b) Authority and Res 
exert authority 
If so assigned, 
responsibilities 


y to take charge of a group and 
ysical exercises. 


nstrate knowledge of watertighe 
1ons. Demonstrate knowledge ° 

the uses of all fire fighting equipment and rescue-breathing 
apparatus. 


(f) First Aid. Demonstrate abi 
cluding artificial respiration. 
344 


conduct infantry drill and ph 
(e) Damage Control. Demo 
integrity and material condit 


lity to administer first aid, i" 
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(g) Arithmetic. Demonstrate a fundamental knowledge of 
elementary arithmetic, including addition, subtraction, mul- 
tiplication, division, simple and decimal fractions, and meas- 
urement. 

(h) Sound-Powered Telephones. Demonstrate ability to man 
a telephone station, handle the equipment correctly, and 
follow standard talking procedure. 

(i) Chemical Warfare. Demonstrate an elementary knowl- 
edge of chemical warfare and defensive measures. 

(j) Surface Preservation. Demonstrate knowledge of paint- 
ing regulations, paints, and painting equipment. 

(k) Survival. Demonstrate knowledge of the proper method 
of abandoning ship, swimming in oil-covered water, and the 
use of life-raft supplies and equipment. 


2. Technical Requirements 


(a) Equipment Adjustments. Start, stop, regulate, and make 
necessary operating adjustments on the radio transmitting, 
radio receiving, radio direction finder (including HFDF), 
sonar, radar, frequency measuring, and vacuum tube testing 
equipment in own ship or station, and know the safety pre- 
cautions involved. This includes the shifting of frequencies 
within the time limit and degree of accuracy set as standard 
within the fleet or force to which attached. When specifically 
assigned, perform the adjustments listed above on Loran and 
Countermeasures equipment. 

(b) Circuit Diagrams. Demonstrate ability to draw and to 
interpret schematic circuit diagrams of simple electronic cir- 
cuits. 

(c) Identification of Components. Demonstrate ability to 
locate and identify component parts of an actual piece of 
electronic equipment by reference to the associated circuit 
diagram. 

(d) Tools. Demonstrate ability to handle properly ordinary 
tools used in routine electronic service work. 

(е) Simple Repairs. Demonstrate ability to make simple 
repairs to standard shipboard electronic equipment under 
qualified supervision. 

(f) Remote Control Systems. Demonstrate a working knowl- 
edge of the electric and electronic remote control systems 
used with equipment in own ship or station. 

(g) Power Supply Systems. Demonstrate a working knowl- 
edge of the power supply systems used with the electronic 
equipment in own ship or station. 

(h) First Aid. Demonstrate a thorough knowledge of first 
aid with emphasis upon treatment for personnel suffering 
from electric shock and burns. 
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B. Examination Subjects 
1. Technical 


(a) Batteries. Have a working knowledge of the types, uses, 
care, and maintenance of batteries used in naval electronic 
equipment. . 

(b) Ohm's Law. Have a working knowledge of Ohm's law 
and be able to apply it in the solution of elementary prob- 
lems. 

(c) Electronic Equipment. Elementary knowledge of the 
purpose and use of electronic equipment used in own ship or 
station. 

(d) Cathode Ray Oscilloscope. Elementary knowledge of 
the theory and operation of the cathode ray oscilloscope. 

(е) Test Equipment. Working knowledge of standard naval 
test equipment used in servicing electronic and related equip- 
ment. 

(f) Safety Precautions. Know the safety precautions to be 
observed with electronic equipment in own ship or station. 
2. General Naval Subjects 


(a) Uniform regulations and care of clothing. 
(b) Discipline and offenses. 

(c) Salutes and colors. 

(d) Manual of arms. 

(e) Drill. 

(f) Handling of boats and oars. 

(g) Knots and splices. 

(h) Compass and relative bearings. 

(i) Visual signaling. 

(j) Swimming and life saving. 

(k) General naval and shipboard organization. 

(1) Advancements and awards. 
(m) Enlistments, discharges, and pay accounts. 
(n) Types, general characteristics, and nomenclature of 

naval vessels and aircraft. 

(0) Daily routine in port and at sea. 

(p) General drills aboard ship. 

(q) Hygiene and first aid. 

(r) Gas protective apparatus, 

(s) Rust removal and painting. 

(t) General safety precautions. 


In-service training and the procedures followed in the advance 
ment of men in the various enlisted Tatings have been described ! à 
Chapter V. Rating and advancement are dependent upon (1) Си Ji 
petence in the technical qualifications and general petty officer ae 
fications as described above, (2) length of service, and (3) i 
vacancies existing at the shore station or ship to which the man 
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attached or in the naval service at large. The latter two requirements 
are largely dependent upon the exigencies of the service. In wartime, 
when personnel needs are great, the number of vacancies is large 
and the length of service required for promotion is reduced; in 
peacetime the number of vacancies is smaller and the period of 
service required for promotion is longer. But in peace and in war, 
emphasis is placed upon training men for positions of greater respon- 
sibility and on promoting them as they demonstrate their capabil- 
ities for positions which require greater technical competence and 
qualities of leadership. 


Examining for Advancement in Rating 


. Responsibility for the in-service training or advancement of en- 
listed personnel rests with the supervising officers and with senior 
petty officers who supervise the study of appropriate training courses 
and give the necessary instruction in the practical factors of the 
rating. Responsibility for checking on the technical proficiency re- 
quired is, in general, delegated to examining boards established at 
local activities which are authorized to develop and administer tech- 
nical examinations to cover the examination subjects set forth in the 
qualifications for specific ratings. 

This decentralized examining program has the advantage that 
members of the boards located at various naval stations are close 
to the actual scene of operation where they may have first hand 
information about the available equipment and operating pro- 
cedures. The continual changes in apparatus and in duties in dif- 
ferent locations have made this close contact with the job a matter 
of primary importance. On the other hand there are certain limita- 
ions to local development of examinations. During wartime even 
Conscientious boards had too little time to develop effective exam- 
Inations. Many activities lacked personnel who were trained in test 
Construction, or who appreciated the importance of technically ade- 
quate examinations, or who possessed the skill necessary to construct 
such an examination. Then, too, the great number of local boards 
engaged in preparing tests led to an inefficient duplication of effort 
at a time when manpower needs were great. It was estimated at one 
time during the war that several thousand naval activities were con- 
structing their own advancement tests, ranging from definitely poor 
to very good. 


Scope of the Examinations 


. The Test and Research Section undertook to assist local boards 
In their examining functions by constructing test materials which 
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met accepted test standards and which introduced a greater degree 
of uniformity into the examining process. Series of examination 
questions designed to be used by the local examining boards were 
constructed, assembled into four books, and distributed to all ships 
and stations. 

The first series of tests were issued in the summer of 1944 as 
Examinations for Aviation Ratings. Included were tests of from 60 
to 90 items for each of four pay grades for fifteen aviation ratings. 
The use of the examinations was optional for local examining 
boards. 

The examinations currently in use (1946) are included in three 
books of Advancement Examinations. Book I consists of materials 
for ratings in the Seaman Branch, Commissary Branch, and Special 
Branch; Book II includes materials for ratings in the Artifice? 
Branch; and Book III, for ratings in the Aviation Branch. The 


complete list of examinations in the current seri 


es is given in Ap- 
pendix В. 


As stated in the introduction to each book of Advancement Exam- 
inations, the items contained therein are not designed to be used 25 
tests, per se, but rather as source material from which selections may 
be made and to which other items may be added in the construction 
of examinations to be used at local stations. The books contain more 
questions than are needed for any one examination. The use of thes? 
items, furthermore, is not mandatory, since it is possible that 1n 
some instances only a few of the items included under any particular 
test topic (examination subject) may apply to the individual ship cd 
station to which the candidate is attached. But the boards are ? 
vised that items should not be excluded on this basis alone if the 
requirements are such that the man is to be qualified for any an 
all duties of his rating. Local examining boards are instructed 


tit С“ с 
prepare additional items when the qualifications require that e 
man give information concerning specific gear aboard his (уре j 
ship. 


How the Examinations Were Constructed 
BASED ON QUALIFICATIONS FOR ADVANCEMENT IN RATING- E 
test developed for the advancement examination books deals Wu 
the specific requirements established foy a particular rating. hes 
qualifications are compiled by the Billet Analysis Section afte”, ES 
tensive observation of the duties performed by men of the vari h 
ratings in fleet and shore billets and as a result of consultation W 
the various technical bur 


hese 
vario! caus concerned. When completed; 
qualifications are published 


2 nel 
m the Bureau of Naval perso” 
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Manual 1 for the guidance of ships and stations in the advancement 
in rating process. The qualifications for radio technician, third class, 
presented earlier, illustrate the type of description of qualifications. 
In building advancement examinations during the war, the Test 
and Research Section has been concerned with constructing items 
for examination subjects, although plans were laid to develop per- 
formance tests and check lists covering the practical factors also. 

The qualifications as established by the Billet Analysis Section, 
therefore, furnished the framework for the advancement examina- 
tions. If the qualifications included seven different examination sub- 
jects similar to those described above for radio technician, third 
class, the final technical examination accordingly was developed to 
cover all of these. Examinations for the higher pay grades also in- 
cluded the examination subjects of the lower pay grades. 

PROBLEMS IN THE CONSTRUCTION OF THE EXAMINATIONS. The first 

major problem encountered reflected the scope of the material to 
be covered. Following are some of the questions which arose in the 
пет construction process: What information should be sampled? 
Ноу applicable is a particular question to operating conditions? Is 
1t inclusive enough? Is it too general? Does the question interpret 
accurately the complexity of the task or job tested? Does the test 
item refer to specific gear? Is the equipment properly identified? 
_ A second problem inherent in the construction of examination 
items was the necessity for making each item as practical and con- 
crete as possible. The use of items testing the application of general 
Principles to specific instances likely to be encountered by the 
average examinee in his daily work was stressed. Items covering 
abstract, theoretical concepts, infrequently applied and less fre- 
quently understood by the examinee, were generally avoided. Items 
involving the memorization of names, dates, places, rules, or laws 
Were kept at a minimum, but the practical applications of these 
factors to the job situation were considered of prime importance 
and were tested accordingly. There was, however, no hesitancy in 
Using technical nomenclature or concepts in the phrasing of the 
questions, since these examinations were designed to evaluate the 
qualifications of technicians in specialized fields. These men were 
Not only required to perform the technical duties of their billets but 
Were to be entrusted with the responsibility of training other men. 
They had to be able to comprehend the terminology of their spe- 
Cialty. Items in their finally adopted form were designed to measure 
Specific information about equipment and operations. 

The third problem to be dealt with involved the selection of the 


“Qualifications for Advancement in Rating,” Bureau of Naval Personnel Manual, 
art D, Chapter 5, Section 2. 
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types of items to be used in the examinations. The field was пат- 
rowed to five principal categories: multiple-choice, matching, com- 
pletion, true-false, and pictorial-matching items. The use of the 
pictorial-matching type was restricted because of the difficulties 
which would be encountered in the duplicating process at local sta- 
tions. In general, more emphasis was placed upon the use of mul- 
tiple-choice and matching items. Completion items were used 
sparingly because of the difficulties inherent in the formulation of 
a fair and accurate key for their scoring. In the final series, approxi- 
mately 70 per cent of the examination items were of the multiple- 
choice type, 20 per cent were of the matching type, 2 per cent were 
of the completion type, and 7 per cent were of the true-false type 
with the remaining 1 per cent being miscellaneous items which did 
not fall under any of the above categories. Table 1-хуш shows the 
Taste 1-хуш. Distribution of different types of items used in the 
Advancement Examinations, Books I, П, and 11 


Type of Item 
И 

Multiple- Miscel- 

Choice Matching Completion True-False — laneous n 
Book No. % у 

No % No. % No. 9, No. % Мо. %  TYP 
I 5453 573 2,808 29.7 339 e 

5 j | 3.6 4 ‘ 
п 5,773 766 157 154 197 18 — 001 23 па o2 758 
ш 6,583 787 1,163 140 10 13 478 58 13 02 sel 


All Books 17,809 702 5423 202 586 25 1628 c4 219 09 25300 


ота of the types of items as incorporated in the examina 
ons. 


a ila 
so had access to material avai the 
au of Naval Personnel and 1D 1005 
well as to achievement examinat 
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previously constructed by the Section. When any given area was 
Not sufficiently covered by the material on hand, additional steps 
were taken to secure the appropriate information from other special 
sources. 

Insofar as possible, each officer working on the examination proj- 
€ct was assigned the responsibility of developing tests in those par- 
ticular areas where his training and experience could be utilized to 
a maximum degree. A number of warrant officers and chief petty 
officers having extensive experience in the various subjects were also 
brought to the Bureau from appropriate field commands to help in 
the compilation of the questions. 

MAINTAINING A Test Irem Еп. In order that the individual items 
of the various examinations might be kept available for ready refer- 
€nce, a filing system peculiar to the requirements of the advance- 
ment examination program has been compiled, each individual item 
(in the case of matching items, each group) was transferred to a 
single McBee Keysort Card, 5 by 8 inches in size. The following 
information was also posted on each card: name of examination, 
examination subject, edition of the examination, and item number. 
Appropriate spaces on the card were provided for information rela- 
tive to the difficulty of the item, and its internal consistency or 
validity against an external criterion. These cards were routinely 
made for every item. Duplicate items in two different examinations 
were posted on the same card when they occurred within the same 
branch of the service, but if they appeared in different branches 
they were cross-referenced from branch to branch. The edges of the 
test item card are provided with a series of small round holes for 
coding some of this information. The top edge of the card is coded 
for branch and rate; the left edge, for the kind of test item (in this 
case, Enlisted Advancement Tests); the right edge for form or edi- 
tion of the test; the bottom edge, for examination subject, and for 
Pay grade within the rating. 

It was realized that, although the cards would prove useful in new 
test construction even though they were coded only by branch and 
Tate, additional service could be provided by using a code based on 
examination subjects. With such a sorting system, all items on 
Optical instruments, for example, could be rapidly assembled from 
any of the rates which would be concerned. Several plans for coding 
the examination subjects were considered. The number of examina- 
tion subjects in the qualifications for advancement in rating roughly 
aPproximated 2,000, but many of these subjects were so similar that 
1t was difficult to determine which were different enough to warrant 
Separate classifications. These examination subjects were accordingly 
arranged in a code system specifically for. use in test construction. 
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Table 2-хуш lists the main topics with their codes. Each test item 
could be coded for one or two of these two-digit code numbers. 


Tasce 2-хуш. Codes for examination subjects used in coding of items 1T 
the McBee Keysort System as set up by the Test and Research Section 


Code 
Number Code Group 


10 to 19 Ships and Planes: Structure and Handling. 

20 to 29 Ordnance. 

30 to 39 Propulsion Machinery; Auxiliary Gear; Ship Layout. 
40 to 49 Accessories (Miscellaneous). 


50 to 59 Electricity; Electrical and Electronic Equipment. 
60 to 69 Fabrication. 


70 to 79 General Physical, Chemical, and Mathematical Principles (except Elec 
tricity, Magnetism, and Metallurgy). z 

80 to 89 Safety and Damage Control; Sanitation; Nutrition; Anatomy; Physiology- 

90 to 99 Supplies; Reports; Records; Publications. 

00 to 09 — Communication and Organization. 


The development of the code system and the original assignment 
of code numbers to the items has been done by the officers concerne 
with preparing advancement examinations. To facilitate the routine 
maintenance and use of the file, a coding manual designed for us 
with the McBee Keysort Card file Was written to describe the 
posting, coding, and card utilization systems. 

The cards are used frequently in the production of new tests: 
They have already proved successful in eliminating the rewriting d 
similar items by different test constructors, in controlling the num- 
ber of similar items used in different editions of a test, in eliminating 
errors which occur from the endless series of typings and retyping’ 


. . . 1 5 
often carried out, and in Sorting out, for reference purposes, d 
already prepared on a topic. 


EXPERIMENTAL TRY-OUT AND 


Wrong answer was chose", pe 
х high scores on the rest 9 cest? 
Mary analyses, the individual dm 
П or rewriting of ambiguous 07 
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practical items. The revised series of tests were then published and 
distributed to the various aviation activities where each command 
was authorized to utilize the examinations as a basis for its own 
testing program, with the addition of locally formulated items if 
desired. It was also requested that completed examinations be re- 
turned to the Test and Research Section for further analysis and 
study. 

Currinc Scores. Before the Examinations for Aviation Ratings 
were distributed for experimental administration, tentative cutting 
Scores were established for each test. Most of the men taking the 
preliminary examinations received scores considerably higher than 
the cutting score, while only a few cases fell below the critical point. 
Many of the examinees had recently completed school training; 
hence it was assumed that their marks would be somewhat higher 
than those of a group who had been serving at sea for some time. 

In actual operation, the cutting scores were established to identify 
those individuals who needed additional training in order to be con- 
sidered qualified in the examination subjects. In determining the 
Cutting score it was practically impossible to set a definite inflexible 
cut on any one examination and still permit a ship or station to 
Maintain its complement, both because of the necessity of rating some 
men to take the places of those detached and because of the wide- 
Spread distribution throughout the world of men taking the tests. 

When Advancement Examinations, Books I, II, and III, were 
issued, no attempt was made to secure normative data or to set 
Cutting scores after trial runs. Since these books were not designed 
as complete comprehensive tests but were considered to consist of 
Pools of items from which the examining boards might select, and 
Since neither the individual items nor the groups of items had been 
calibrated for difficulty, the resulting examinations as developed by 
the boards were characterized by variation both in emphasis and in 
level of complexity. Under these conditions it would not have been 
feasible to designate cutting scores for all activities. The previously 
established requirement of the Bureau of Naval Personnel, that the 
final technical examination must be passed with a mark of 9.5 (62.5 
Per cent), served to set a somewhat flexible standard for the local 
examining boards. 


Evaluation 


The development of advancement in rating examinations for each 
Pay grade in 50 ratings represented one of the most ambitious testing 
Programs undertaken by the Test and Research Section. Although 
the examination program falls short of ideal standards with respect 
to experimental try-out of tests and standardization and uniformity 
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of use, it did constitute a practical solution to a very difficult prob- 
lem. One of the major obstacles to the development and use of the 
typical standardized achievement examinations has been the variety 
of equipment found aboard different types of ships and the varied 
nature of Navy jobs bearing the same name. This difficulty was met 
by delegating responsibility to the local board for building examina- 
tions and by requiring satisfactory performance on the types of 
equipment found at the local station or aboard a specific ship. 
The work in the development of advancement examinations was 
not completed during the war. If the best qualified individuals are 
to be advanced in rating, the program will have to be greatly ex- 
tended. Examinations to cover proficiency in practical factors as W ell 
as in examination subjects will have to be built. Wherever possible, 
only items of known difficulty and validity should be used. In peace 
time, extensive experimental try-out of items should be feasible. BY 
building examinations which provide a valid measure of the pro- 
ficiency of personnel, the Navy will insure a highly qualified staff of 


petty officers capable of discharging effectively the varied duties те 
quired in their billets. 


PART V 


FOLLOW-UP STUDIES OF TRAINING AND 
CLASSIFICATION TECHNIQUES 


63°. 


CHAPTER ХІХ 
PROBLEMS IN ESTABLISHING CRITERION MEASURES 


In personnel research no subject is of greater importance than the 
nature of the criterion to be used in evaluating performance. The 
criterion provides a means of isolating variables associated with 
individual differences in success, of separating efficient test items, 
subtests, and tests from those less efficient, of determining effective 
weights to be used in combining tests, and of evaluating existing 
training and classification procedures. In short, the criterion deter- 
mines to a large extent what the findings and recommendations of 
a research study will be, and hence it may influence greatly adminis- 
trative procedures involving selection, classification, training, assign- 
ment, and promotion of personnel. Use of an unacceptable criterion 
In a research study may result in policies or procedures which will be 
injurious to the development of sound personnel practices. In view 
of this importance to naval personnel research generally, and in 
order to introduce the reader to some of the problems encountered, 
it is considered desirable to indicate the essential characteristics of 
an acceptable criterion measure, to outline some of the problems 
Which are involved in establishing such measures, and to present a 
brief critical analysis of the criteria that have been used in Navy 
research studies. 

Derinitions. The term criterion is applied to a performance 
measure which is used as a standard in evaluating other measures. 
It is also a means of describing the performance of individuals on a 
success continuum. The term "measure" is applied to the result of 
à process by means of which symbols are assigned to an individual's 
performance to designate (1) the presence or absence of a discrimin- 
able characteristic, or (2) a value representing a rank order position 
On some assumed variable. Depending upon the definition of the 
Success continuum, a criterion used in Navy studies may include 
one or more of such variables as an individual's final school grades, 


_ his scores on proficiency tests, his position in the enlisted pay grade 


scale, an appraisal of his ability to direct the work of others, a rating 
of his skill shown in performing his job, the quality and/or quantity 
of work produced, his expressed job-satisfaction, and the judgment 
of supervisors or peers as to his overall success. The measure finally 
adopted may be composed of ratings, of scores or responses from 
controlled test situations, or of both of these. 


Basic AssumprTions. The major assumptions to be made in con- 
357 
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sidering the development of a criterion are (1) that a scale or con- 
tinuum of success does exist for Navy billets, (2) that individual 
differences in success can be discriminated, and (3) that numerical 
values or categories can be assigned which for practical purposes will 
stand for the set of rank orders representing the observed individual 
differences in proficiency. . 

'The first of these assumptions, that of a continuum of Success, 15 
often made, however, without an understanding of the multiplicity 
of factors contributing to the success variance of the population. 
Although it may be convenient to think of success as a unitary 
variate, it is nearly always multidimensional in character. Seldom, 
therefore, will a single variable provide the required degree of dis- 
crimination between individuals on the total success scale. A single 
composite value representing overall success as а radioman, for 
example, would involve consideration of such skills as receiving and 
sending code, Operating equipment, using communication proce 


pervising a group of apprentices, and 
working as a member of a team. 


or of rank orders of success) are 1 ten 
і € imperfectly defined. Hence, €X 
sive study of the areas of P T define 
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and include all significant aspects of that performance; that is, it 
must possess the qualities of pertinence and comprehensiveness. 
Second, it must consistently discriminate between different levels 
of performance, thus fulfilling the requirements of discrimination 
and reliability. Third, it must produce comparable results from 
individual to individual, from group to group, and from situation 
to situation. Each of these characteristics will be discussed more fully 
below. 

PERTINENCE AND COMPREHENSIVENESS. The first important require- 
ment of an acceptable criterion is that it must be pertinent to the 
performance being studied. If one were interested in predicting the 
technical competence of a radioman, it would be a mistake to evalu- 
ate him on such factors as how hard he works, how well he gets along 
With others, or his military appearance. All too frequently, research 
workers accept whatever criterion is available and assume that it is 
relevant to the type of performance which they are interested in 
predicting. The exclusion from the criterion of all extraneous vari- 
ables not strictly bearing on job performance should be one of the 
first steps in designing a research study which aims to predict success 
on the job. 

A concept closely related to pertinence is that of comprehensive- 
ness. Although an acceptable criterion must not include extraneous 
Or irrelevant factors, it must include all of the important compo- 
Nents of the areas of performance delimited by the definition of 
Success, A measure may be pertinent; but if it deals with only one of 
а series of variables which contribute to the composite success vari- 
ance of the performance area under scrutiny, it cannot, by itself, be 
Considered a sufficient criterion. For example, it would be quite 
Inappropriate to accept code receiving as the sole criterion of the 
technical competence of a radioman. Code receiving is relevant to 
the criterion but it is not the only factor which determines the 
technical competence of a radioman. 

CRITERION Матлртту. In test construction, the characteristics here 
called pertinence and comprehensiveness are usually subsumed 
under the concept of validity. A test is valid to the extent to which it 
measures that which it purports to measure. In many test situations, 
the validity of the test can be defined as the correlation between the 
test and another measure which has been accepted as a standard. 
Here validity can be considered as a statistical concept. But in the 
development of an original criterion of success, no such standard 
exists, If there were such a standard, one would adopt it as the 
Criterion rather than spend his time developing a new one, unless 
the existing standard were too inconvenient for practical work or too 
57055 to yield satisfactory discrimination. In the development of an 
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original criterion, as in the development of a test in an area he 
which no standard exists, validity is a logical rather than a statistica 
concept. 13; 7 
he two logical divisions of the statistical concept of ges cm 
pertinence and comprehensiveness; the magnitude of a validity 
coefficient is a function of (1) the extent to which the thing meas- 
ured by the experimental test is relevant to what is measured by 
the standard (pertinence), and (2) the extent to which the experi- 
mental test measures or includes that which is measured by me 
standard (comprehensiveness). In the case of any original measure, 
the test of validity should be whether these two characteristics are 
present to an adequate degree. It is, therefore, a matter of Јода 

The problems involved in developing criterion measures which 
will be pertinent and comprehensive and which will be acceptable 
to all interested parties are those of (1) careful definition of the area 
with respect to which the performance of individuals is ta be 
evaluated, and (2) reduction of the influence of extraneous variables. 
These problems will be considered in a later section. 


Supe [3 
DISCRIMINATION AND RELIABILITY. A criterion measure cannot b 
considered acceptable unless it indice 


existing differences between indivi 
formance under scrutiny. In gene 
success do exist; the me 
to obscure them unduly 


: E indi- 
or in the assignment of an й 
vidual to а position on the scale of success will be minimized. ТЕ ће 
s arising from variations in t 
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ng procedures, and in the зсоп то 


assigned. 

RELATION OF DISCRIMINATION 
ACCEPTABILITY. Discriminatio 
the problem of accuracy of 
chapter). In relation to a crite 
siveness are logical concepts, 
usually expressed as statistica 
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defined in terms of the criterion measurement data. Discrimination 
and reliability are interrelated to a considerable extent, but are 
Sufficiently distinct to warrant separate consideration. Discrimina- 
tion is concerned with the number of categories of success to which 
‘individuals are assigned, the categories representing observed dif- 
ferences in performance. Reliability is concerned with the stability 
ОЁ the values assigned by the measuring technique. It is clear that 
no matter how much apparent sensitivity in indicating individual 
differences an instrument may possess, its effective discrimination 
between individuals is limited by the amount of chance error con- 
tained in the values assigned. 

The importance of a reliable measure can be seen from the fol- 
lowing example. If commanding officer "A" states, in filling out 
Ensign Smith's fitness report, that he would "particularly desire to 
have him" and the executive officer, having observed Ensign Smith 
Over the same period of time and under the same circumstances, 
Should state that he “prefers not to have him," the two reports would 
be in disagreement and the results would not be termed reliable. 

If both the commanding officer and the executive officer indicated 
that they would "particularly desire to have" all of their officers, 
that one was no better than another in general value to the ship, the 
ratings would indicate no discrimination between the officers being 
Tated and would be worthless as criterion values even though agree- 
ment was secured. Of course, rare instances may occur in which a 
Broup of officers are actually equally good or poor in all areas of per- 
formance under consideration, but the frequent lumping together of 
Individuals on rating forms is almost entirely a failure to indicate 
differences in proficiency which actually exist. 

СОМРАВАВИЛТУ AND CriTERION MEANING. The importance of 
Comparability of values is readily appreciated when comparisons are 
to be made between individuals who have been tested or rated at 

ifferent times or under different circumstances, or when data for 
Samples from separate ships, schools, and so forth are to be combined 
Into a tota] sample. If Rogers, Gunner's Mate third class, is assigned 
а criterion value of 8 representing a specified level of competence 
9n one ship, and if Jones, Seaman first class, is equally competent in 
the area being measured, he too should be assigned the same value 
ОЁ 8 even if he is a non-rated man and on another ship. Most scores 

"Om test situations and the values from some types of rating de- 
vices or check lists can be considered comparable in this sense. Lack 
of comparability of measures usually develops from the absence of a 
Single set of reference meanings which can be applied to the evalua- 
Чоп of performances. 

Since it may be desirable to combine the criterion values for 
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several groups of individuals for purposes of analysis, e 
usually wishes to generalize from a sample to а tota раа я 
the comparability of the values from group to group m = ја 
considered. The use of procedures which yield values comps A 
only for the individuals in a particular sub-sample of the tota popa 
lation studied, leads to the difficult problem of securing em z гӯ 
bility. Statistical techniques of “within-groups” analysis пиће и 
justing differences in mean scores are available when compar crane 
of values from group to group cannot be assumed; but use we um 
techniques, especially if the assumptions are poorly satisfied, rend 
result in some loss of precision. It is preferable to employ varial a 
or sets of variables whose values will have a standard meaning a а 
spective of the individual to whom applied, the group of which h 


his 
happens to be a member, or the test or rater used to evaluate 
performance. 


Problems Met in Developing an Acceptable Criterion 


The general problems encount 


Р ME ene 
ered in the development of c 
terion measures have already been 


indicated as follows: 
Definition of the areas of performance, 

Reducing the effect of extraneous variables, 
Increasing the accuracy of measurement, 
Increasing comparability of test scores, 


. H are 
asized again that the problems ries 
те divided into certain catego 


many different aspects— 
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Navy follow-up studies, this is determination of vocational success 
in performance on the job. 

A definition of the purpose of the study may be the only defini- 
tion of success required, if the purpose can be precisely stated. For 
example, if the purpose of a study is to predict the success of men 
copying both machine and hand-sent radio code under operating 
conditions, no other definition of the criterion is required. This 
statement delimits the areas of success to those pertinent to the риг- 
pose of the project. A similar restriction in the areas to be included 
would occur if the purpose of the project was to evaluate the effec- 
tiveness of a motor machinist’s mate school in teaching the oper- 
ation, maintenance, and repair of diesel engines. In this situation, 
an individual’s leadership qualities, his adjustment to Navy life, and 
his work habits would be irrelevant except insofar as they might be 
germane to success in operating, maintaining, and repairing diesel 
engines. If developing technical competence were the prime ob- 
jective of the school, the criterion used to evaluate the school’s 
effectiveness should be confined to measures of technical compe- 
tence on the job. 

On the other hand, the objective of a research study may be a very 
general one, such as the prediction of overall success as a signalman. 
This objective will require the evaluation of performance in all 
areas which make for success in this billet. Success as a signalman 
may include proficiency in receiving and sending flashing light 
messages, knowledge of communication procedure, skill in sending 
semaphore or in bending on and hoisting signal flags, ability to work 
With and handle men, proficiency in standing lookout watches, and 
the satisfaction expressed for the job. . 

The purpose of the project sometimes can be presented in the 
form of a functional question which will delimit, by implication, the 
areas of success. Such a functional question was used in a study of the 
Performance of junior officers aboard ship. Each reporting senior 
Officer was asked to nominate the junior officer he would most want 
to take with him to his next ship (the purpose of the study being 
to identify superior and inferior junior officers). This statement was 
sufficiently meaningful to these senior officers. They tended to agree 
on the officers so selected, even, in some cases, to the extent of giving 
identical reasons for wanting or not wanting a specific junior officer. 
The nominations for high or low, since they represented reasonably 
reliable ratings, constituted data by means of which a set of criterion 
Broups was identified. 

SELECTION or IMPORTANT AREAS OF PERFORMANCE. If analysis of 
the purpose of the project indicates that several areas of performance 
would be included in the criterion, these areas can be identified 
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through (1) job analyses which include statements of the psycho- 
logical, social, and physical characteristics of the job, (2) opinions of 
experts as to the importance and relative frequency of occurrence 
of the suggested areas, and (3) experimental and statistical studies 
of proposed criterion measures. Complicating factors in identifying 
the important areas are the problems of securing job analyses which 
are more than billet descriptions, of selecting experts who are com- 
petent to make the necessary judgments, of insuring that minimum 
essentials are included even though some groups are homogeneous 
with respect to such areas, and of submitting the measures to an 
experimental check. 

DIFFERENTIATING BETWEEN AREAS oF PERFORMANCE. If a measure 
is to be used as indicating the success variance in only one aspect 
of performance, it should be possible to show that the measure does 
reflect success in that area alone. This requirement means that the 
values on one criterion measure must be to a discernible extent 
independent of the values representing success in other areas. Judg 
ments of "technical competence" and of "petty officer qualities, 
for example, were found in a study reported in Chapter XX to be 
practically the same judgments even though extensive definitions 
of each of these two areas had been set up, and even though in 150 
lated cases, instances of a lack of correlation between the two азресе 
of success aboard ship were found. In the light of these data the 
terms "technical competence" and "petty officer qualities" do not 
appear to indicate aspects of success which can be differentiated by 
rating procedures. 

The high average intercorrelation usually secured between ratings 
of a wide variety of traits may mean that the traits as found within 
the individuals are actually highly correlated or it may mean oF 
that the judges are unable to discriminate between these traits be 
cause of a general “halo effect.” To ask raters to make separat? 
judgments of a group of individuals on four or more traits 
usually prove to be asking them to give the same evaluation [09 
more times. If such traits are to be differentiated, other technique? 
such as tests, must be developed for their differentiation and 762% 
urement. 
| The evidence that the areas subsumed in a criterion are differ?" 
tiable is statistical in nature if values for the areas in question ^, 
be assigned. A comparison of the correlation coefficient between ' Я 
variables with the geometric mean of the reliabilities of the 9^ an 
two variables will indicate roughly whether the two measures Pt 
be considered as measures of the same or of different areas. 4 Rc 
test of the hypothesis that several dimensions are involved may pe 
secured from a factorial analysis of a set of criterion measure 
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results of which will indicate the number of dimensions required, 
the variables which can be used to measure the different dimensions, 
and the extent to which the common factors account for the variance 
of the separate measures. If a single overall measure has been se- 
cured, the question of what is being measured can only be answered 
with descriptions of the procedures used and of the data obtained. 
The research worker must then decide on the basis of these descrip- 
tions whether the results can be accepted as indicating performance 
differences in the defined area of success. 

ADEQUACY oF DEFINITION OF AREAS OF PERFORMANCE. Satisfactory 
evaluation of the adequacy of the definition of success can only be 
arrived at after preliminary trials of the proposed measures. Neces- 
sary for such evaluation are (1) descriptions of procedures used 
(list of experts consulted, outline of job analysis results, statement 
of operations used to increase the probability that the important 
areas are covered and that the effect of extraneous factors has been 
considered), and (2) statistical data showing the extent to which 
success in several areas can be differentiated, the discrimination ob- 
tained between individuals, and the reliability of the measures. 
Since these data also constitute evidence of accuracy of measurement, 
the adequacy of the definition of the areas cannot be satisfactorily 
evaluated until the problems of measurement (discussed later) are 


also solved, 


Reducing the Effect of Extraneous Factors 


Even though the areas of performance comprising the criterion 
Measure have been carefully defined, there is always the danger that 
extraneous factors will contaminate the final results by introducing 
irrelevant sources of variation. Some of these factors exist in the 
environment in which the individual works, some may be inherent 
in the equipment which he operates, and others may exist in the 
minds of those who do the evaluating. In any case, every precaution 
Should be taken to reduce the effect of these factors to a minimum. 

CONTAMINATION BY KNOWLEDGE OF PREDICTOR VARIABLES. One 
such extraneous factor is the knowledge and use of selection and 
training data in the rating for advancement of individuals on the 
job. Knowledge of the background information results in a con- 
tamination of the criterion, since an individual’s position on the 
Scale of success is no longer a function solely of success on the job. 
The use of this background information is generally defended on 
the ground that increased precision in promoting individuals or in 
assigning them to specific jobs is achieved through such knowledge. 
It should be pointed out, however, that this does lead to a spuriously 
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high relationship between the selection or training а Lcx 
the criterion. For the most acceptable criterion, this type o be 
tamination of the criterion data should, if not excluded, at py "и 
considered in evaluating the results. (See Chapters IX and X 
illustrations of the operation of this factor.) - 
Biases or Jupcrs. Both supervisors and peers frequently poss of 
misconceptions of the importance of particular auspice um 
behavior. Their judgments reflect not variations in partu 
but the judges' likes or prejudices. The military rank held by a 
individual, his length of service in the organization, and hiy e 
amount of experience in the Navy are illustrative of the iem ЈУ 
which may cause а rater to err in his evaluation of an — à 
level of competence. The preconceptions held by the responde " 
regarding the desirability of transferring individuals from one sm 
of Navy duty to another or of the desirability of shipboard as xar 
pared with school training are also sources of bias. These oe 
ceptions can sometimes be evaluated, or their effects can be dd 09 
provided the procedures used in training of raters and in the co 
tion of data are sufficiently extensive and complete. per 
EFFECT OF AMOUNT OF EXPERIENCE. The effect of amount 0 ка x 
perience on the job upon criterion values should be estimated, Essi 
cause the criterion value desired should represent the position O at 
individual at some fixed point of experience. There may be 50 


: А Х 1 [ex 
value in developing a measure which will reflect amount О 
perience if such a measure is not 


experience can usuall 
ords. The effect of ex 
of performance as w 


or 
Fact 
CHANCE ASSIGNMENT FACTORS. Another type of extraneous f det 


one or to one billet rather than яно; er 
Two individuals, equally competent, may have had marked КШ 
ences in opportunities for advancement and for increase iP “rot 
and general competence. The net result of this inequality a nó 
they will be evaluated by superiors or peers on quite different * пне 
ards; their performance on objective measures may also be јл 
different. The criterion measure will reflect these differen 
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performance but the source of the differences cannot be traced to 
the usual predictive factors. It appears to be true that replacements 
sent to a well organized ship with a fairly full complement will have 
fewer opportunities for learning all aspects of given jobs and for 
showing their abilities and skills than if they had been sent to a 
newer ship. Similar chance factors may result in the individual’s 
being assigned to a job with the ship which offers much or little 
Opportunity for advancement. The evaluation of the effect of some 
of these factors upon the criterion can sometimes be accomplished 
through the design of the sampling procedures, thereby increasing 
the precision of the results. и 


Increasing the Accuracy of Measurement 


Associated with the problems of restricting the areas of perform- 
ance to those pertinent to success are the problems of assigning 
values which can be used to represent differences in performance 
in these areas. The process of assigning the appropriate values, 
usually called measuring, consists of securing judgments (of “greater 
than or less than," "present or absent," and so forth) with respect 
to some aspect of an individual's behavior, including his perform- 
ance in controlled or test situations. Attempting to increase the 
accuracy with which these values are assigned raises such questions 
as: (1) Are the procedures used such that similar values will be 
assigned to an individual's performance by comparable judges (or 
tests) and at different times? (?) Will the values assigned permit the 
Separation of the individuals into groups homogeneous with respect 
to judged differences in behavior? The first question deals with 
Problems of reliability of the procedures; the second question is 
Concerned with securing measures which discriminate between indi- 
Viduals. It should be emphasized that these two questions do not 
deal with the problem of what is being measured, i.e., whether the 
Values on different measures represent differences in behavior in 
Separately defined areas of performance. Only if the several measures 
Prove to be reliable and permit discriminations between individuals, 
Сап the question of whether the values represent differences in dif- 
ferentiable areas be raised and determined. 

PROBLEM or RELIABILITY. Improvement in reliability is concerned 
With reducing the amount of random fluctuation or chance error 
that may occur in the measurement process. Close agreement (ђе- 
tween comparable tests or independent judgments of respondents) 
às represented by correlation coefficients of .80 to .90 can be con- 
Sidered as acceptable criterion reliability. Lack of agreement, or low 
reliability, is often traced to three sources: (1) characteristics of the 
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measuring procedures, expressed as "test reliability," (2) B -— 
of the evaluation procedures, termed objectivity and expre 3 vill. 
"reader reliability," and (3) the stability of the trait within pr^ 
vidual himself, which is expressed as "individual reliability. e 
three sources of error variance are discussed in any adequate ae 
psychological measurement, but they are mentioned here a 
of their importance in developing an acceptable criter as kn 
operation of any of these sources of error will lead to the s 
statistical result—a lack of agreement. tua 

RELIABILITY OF TEST SITUATIONS. In carefully controlled test st A 
tions the resulting scores are usually more reliable than those aun’ 
from rating procedures. The lack of reader reliability in the i ob: 
ing of scores is usually effectively reduced by making the ger 
jective, ie. by securing responses in such a way that the P4 from 
biases or preferences of the scorer are minimized or eliminate ality 
the evaluation of the performance. The use of devices such as У tg 
scales, short answer written items (as multiple choice or sae: 
items), accurate tolerance gages, and check lists for perfor a ull 
tests may result in close agreement between the scores ог У 
assigned by two or more readers, checkers, or scorers. оте of 

The lack of test reliability can often be traced to one or m 
the following characteristics: 

:adi- 

(1) the indusion in the t Ы 
vidual's proficiency, 

(2) ambiguity in the directions or test situations, 

(3) the individual’s unfamiliarity with the test situation, 


s E Бает, . jon 
(4) differential motivation or acceptance of the test situati 
individuals, 


(5) variation in the testin 
(6) variation in the difficu 
(7) variation in the homo 


А he 
est of an inadequate sample of Ч 


by 


8 conditions or procedures, d 
Ity level of the parts of the test, eit: 
geneity of the tasks covered by the 


«prove 
The first two items are those most frequently in need of іар gef 
ment. A more adequate sample of performance may require veri 
more carefully designed tests, or it may require a set of tests CO n 
the various sub-areas. Ambiguous directions or tasks will io maf 
the same thing to different individuals, and a given она sol 
well interpret them differently on two separate occasions. А 
tion of these problems is often a trial and retrial process- lia init 
RELIABILITY OF RATING SITUATIONS. Estimates of the Te r^ res 
of ratings and rankings tend to be lower than those input да 
situations. This general increase in the estimated error oe P 
judgmental values is traceable to an appreciable degree tO -— 
culty of securing comparable judges. In a test situation CO™ 
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forms of the test are defined in terms of the selected content and in 
terms of the statistics of the test-score and item-response distribu- 
tions. Comparable judges, however, are sometimes defined (in a 
circular fashion after the ratings have been obtained) as those for 
whom agreement is secured. о 

Comparability of judges should be discussed first in terms of the 
Opportunities each judge has had to observe the characteristics to 
be rated, his ability to make the desired discriminations, and his 
interest in doing so. But securing comparable judges does not in 
itself insure reliable ratings. Variation in the relative weights by 
which the judges combine their impressions, variations in the 
behavior observed and in the way it was observed, and variations in 
the standards of evaluation from one judge to another lead in gen- 
eral to disagreement between judges. 
, Extensive training of the judges in eliminating personal biases, 
In evaluating a certain pattern of behavior, and in weighting the 
elements in a similar fashion is one means of increasing the reliabil- 
ity of the ratings. The use, both during the training period and 
during the collection of data, of extensive check lists and descrip- 
tions of the trait rated (expressed in terms of the respondent's vocab- 
ulary) tends to reduce variations in interpretations. Selecting judges 
Who have had an opportunity to observe the behavior over a period 
of time, training them, requesting only judgments upon discrim- 
Inable characteristics, and directing the process of rating or ranking 
IN а personal interview as was done in the collection of criterion 
data discussed in Chapter XX should lead to judgmental values of 
acceptable reliability. , А 

Discriminatinc Measures. While reliability is an important at- 
tribute of a measuring instrument, it is equally important that the 
Measure indicate differences between individuals, differences which 
Teflect the degree of success achieved. Solutions to the problems of 
Measuring a defined area of success, and of measuring it reliably, 
Will be of little value unless the criterion measure provides a spread 
Of scores so that the more capable individuals can be effectively 
Separated from the less capable. Homogeneous groups can be found 
n which the individual differences on the proposed measure of 
Performance are so small that they cannot be reliably discriminated, 
with the result that all of the individuals in such groups are assigned 
the same criterion value. In such a situation more discriminating 
Measures must be secured if the criterion is to be considered ac- 
ceptable. 

Discriminable differences in success do exist even in homogeneous 
Sroups and in areas of performance which can be called “minimum” 
essentials. The problem is to develop, within the defined areas, tech- 
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niques which will insure that observable differences will be ee 
cated and that the assigned scores or ratings do provide a spread о 
scores. A spread of judgments or ratings can be secured by using 
order-of-merit rankings or by requiring the judges to place a given 
number of individuals in each category of the rating scale. The 
ratings or rankings from a group of judges can then be scaled by 
available psychometric procedures.! If the ratings have been secure 

by a procedure recommended by Horst,? and providing the jaag 
have rated the same men, an origin and unit can be determine 

for each judge. Discriminating measures can usually be secured from 
test situations by varying the difficulty and number of tasks pre- 
sented or by using length of performance time as well as accuracy 
in the scoring. Unfortunately, test scores or grades, as well as ratings 
often exhibit a lack of discrimination so marked that extensive 
research is necessary to develop a suitable technique for discrimi- 
nating between levels of performance. 


Increasing the Comparability of Criterion Values 


i А А " it is 
Since the absence of a rational zero point and a rational unit 


RDA ~ о 
characteristic of nearly all psychological measures, the problem mee 
comparability of the values or categories used in measures of P f 


formance is a general one, Comparability refers to the constancy 9 
Interpretation, i.e., will the assigned values represent approximate 
equivalent levels or characteristics of performance for different 1” jg 
viduals, different groups, and different situations? The procedure) 
suggested to increase the. comparability of the criterion values W! 


situation. Such a score does 


is than another or what a score of this magnitude means in ter™ 


1 Guilford, J. P. Psychometric Methods, Part " к, 1936: ial 
Я І. z York, fa 
2 Horst, Paul. The Predict; П. McGraw-Hill, New 50 
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level of performance. The latter could be accomplished only by 
some sort of scaling procedure. ' 

Ratine VaLurs. A much more difficult problem of comparability 
occurs when no test techniques are applicable or feasible and when 
a criterion consisting of ratings is „| Noncomparability of ratings 
may result from variations in (1) the judges’ interpretations of the 
definition of the scale, (2) opportunities for observation of the be- 
havior being judged, (8) the individual standards applied to the 
observations made, and (4) the abilities of the judges to make the 
desired discriminations. The procedures (described earlier) of train- 
ing the raters and of confining the ratings to observable behavior 
are not only means of improving the reliability of judgments but 
also of improving the comparability of the ratings. The requirement 
of a high level of agreement between judges for the assignment of 
Individuals to categories on a qualitative variable provides a means 
of increasing the assurance that the judgments do represent com- 
parable performance characteristics. _ 

If the ratings purport to represent the positions of individuals on 
а scale of success, as do order-of-merit rankings and various types of 
rating scales, lack of comparability most frequently arises from dif- 
ferences in the standards of evaluation used by different judges. 
Some judges consider a particular characteristic as being more, or 
less, damaging to overall success than do other judges. These differ- 
ences in standards are also complicated by differences in the level 
of achievement which are characteristic of the groups the judges 
have known in the past. Attempts to have the judges consider “all 
the men in the Navy today" have not given results much different 
from those secured from comparisons confined to the groups actually 
being judged. Differences in the means and standard deviations of 
the ratings of trained judges, however, can be made small enough to 
Permit the acceptance of the rating values as comparable. 

The use of an order-of-merit ranking or the use of ratings in 
Which the minimum number of individuals in each category is 
Specified provides a means of forcing discriminations between indi- 
viduals which, other things being equal, will increase the compara- 
bility of the ratings. If the ratings or rankings by a number of judges 
On a trait, or on a set of traits, are secured for a group of individuals, 
the differences in the means and standard deviations of the ratings 
&iven by individual judges can be adjusted, and more nearly com- 
Parable scores can be obtained by Horst's? procedure. These pro- 
Cedures, however, do not provide a means of comparing individuals 
from group to group unless there exists an appreciable overlapping 
9f respondents between groups. Since this condition rarely obtains 

3 Horst, loc. cit. 
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in the Navy, comparability of ratings from one group to another is 
often assumed on the premise that the means and variances of the 
several groups would differ only by chance. When this assumption 
is made, order-of-merit rankings are often used and the ranks com 
verted to standard score or sigma values on the further assumption 
that the distribution of the true measures of performance is normal. 
When the values can be considered as representing only an indi- 
_vidual’s position in an intact group and the mean criterion values 
are not assumed to be equal, only within-group analyses of the 
criterion scores are permissible. 

Another procedure for increasing the comparability of ratings 
requires the use of several criterion measures, including at least оП6 
measure correlated with the ratings which can be assumed. to result 
in comparable scores from group to group. Differences in the rating 
means and standard deviations of the groups can then be assume 
to be proportional to the differences in test score means and standar! 
deviations, and appropriate translation equations can be determine® 

, UNtrs or MEASUREMENT. When criterion measures are to be cO?" 
bined, both the constancy of meaning of scores on a single measure 
and the extent to which similar criterion symbols represent similar 
levels of achievement should be considered. If the set of measure 
consists of scores from controlled test situations, the constancy of any 
em iic can generally be assumed. The problem then invo ves 
ciue oni ls re tes tiga ер evaluating the performance 0 а 

establishin о € standards are usually secure 

5 g sets of derived scores, such as standard scores OT pe 
centile scores, in which the separate performances are evaluate 
terms of the performances of some standard or norm group: R^ 


Pm 5 В d for 
use of such derived scores provides an arbitrary reference point fo 


9 
we i ај a miri 50, and an assumed unit for all of the meas 
such as is provided b i iati 

P y a scale with a standard deviation of 10- the 


combination of such derived scores then is not influenced > 
variations in the standard deviations and in the means of Фе meas 
ures, which are usually artifacts of the test desi | r 
When judgmental ratings are to be ambu with test score? a 
when different ratings are to be combined, adjusting the means 2 jl 
variances by using standard scores is also a а riate. The ori nes 
ratings, however, should provide a fairl Hs d read о X 
and should be reliable; otherwise, the pis inci ai give «ed 
proportionate weight to the unreliable and non-discriminating ! ni 
ure. If several judges have been used, the differences in means he 


ке чај of their ratings should be adjusted before combining 
values. 
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Combining Criterion Measures 


It has been pointed out that in some situations the requirement 
of comprehensiveness cannot be met by any single criterion measure. 
In other circumstances, judgments of overall success cannot be se- 
cured reliably or with sufficient discrimination. In still others an 
overall criterion may be unobtainable, or obtainable only at pro- 
hibitive cost of time. In many of these cases the difficulty of securing 
an acceptable criterion can be solved by developing sets of measures, — 
each unit of which satisfies the requirements of pertinence, reliabil- —— 
ity, and discrimination, and then combining these separate measures 
to form a single composite criterion. In the procedures for com- 
bining measures which are discussed below, two general cases occur: 
(1) an overall measure is temporarily available for use in the re- 
search, but it must be replaced by a group of measures in a practical 
situation; (2) no overall measure is available, even for the research 
study. 

COMBINING MEASURES USING AN OVERALL CRITERION. Whenever 
an overall criterion is available, it may be used as the controlling 
variable for evaluating and weighting a set of supplementary cri- 
terion measures to form a composite variable. The problem is to 
combine and weight the independent variables so that the com- 
posite will conform as closely as possible to the overall values with 
the desired increase in reliability, discrimination, or convenience. 

If the overall criterion is a quantitative one, the procedure to be 
used is basically a multiple regression procedure in which the de- 
pendent variable is the overall criterion. Consider an example of 
this type of problem and its solution by one of the services during 
the war. It was desired to develop a criterion of officer success which 
could be routinely applied in peacetime as well as war. The unique 
conditions of war provided a large group of officers who were 
capable of judging the overall performance of their fellows in com- 
batant and non-combatant situations. By pooling the judgments of 
these officers as to the success achieved by their fellow officers, an 
acceptable criterion of overall performance was secured; but this 
criterion was not one that could be secured except under these spe- 
cial war conditions. Therefore, in order to secure a more generally 
applicable criterion, a series of supplementary measures which could 
be applied at different times and under different conditions was 
developed simultaneously with the overall judgmental criterion. 
These supplementary measures consisted of achievement test scores, 
Tatings by supervising officers on carefully constructed rating forms, 
and ratings by panels of selected officers. These supplementary 
Measures were then combined so that the single composite value 
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corresponded as closely as possible to the averaged ey lae oe 
of the large group of fellow officers. This procedure о e te avail 
criterion measures can be used only when a single measure is c 29 
able to determine the weights to be assigned other measures іп с 
bination. . E 
If the overall criterion is a qualitative one (e.g., provides only id 
terion groups characterized by the presence or absence of dich. 
attribute), the problem is still one of determining the weights w 76 
when applied to the supplementary measures, will аара 
between the two groups as much as possible. This problem cal ai 
solved through the use of Fisher's discriminant function, or em 
able approximation of it. It has been shown that the discrimine 
function can be considered as a regression problem with the е" 
criterion, the dependent variable, assigned values of 0 and l. Jd» 
The most crucial phase in the procedure described in а 
ceding paragraphs concerns the acceptability of the overall ait dm 
since it is used to determine the proper weights to be assigne if it 
supplementary variables. If the overall criterion is biased, or Ё 
unintentionally places ап emphasis on relatively unimportant wi 
ables, or if some variables are omitted entirely, the composite n i5 
reflect these same weaknesses or biases. When the overall cid 
used as the controlling element in selecting supplementary meus | 
the closest scrutiny of the suitability of this measure is ан ате 
Other complicating factors in the combination of variables ey 
the reliabilities of the Separate measures, the units in which ори" 
are expressed, the homogeneity or heterogeneity of the sample Pow T 
lation, and the extent to which the supplementary measures 


3 2 : ess о 
all of the important areas of Success, that is, the comprehensive? 
the set of measures. 


The influence of restriction or 
on the covariance matrix has b 
The effect on the intercorrelati 
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being to depress the magnitu 
long as the measures are to b 


tio? 
of pre-selection of the popula 


Ш. 
een noted in Chapters XII and Ў res 


ons of the separate criterion stot lt 
of prediction variables, the net р É 
de of the average intercorrelat e а 
€ used with the sample popula, if 
with similar populations, the obtained coefficients can be US com 
the measures for a more heterogeneous population are to bé арі 
bined, using the weights determined from the homogeneous 19 
estimates of the population weights might be made using th јаве 
cedure suggested by Burt,5 in which the sample regression „ве 
4 Garrett, H. E. “The Discriminant Function and Its Use in Psychology,” psycho 7 
vol. 8, No. 2, p. 65, June, 1943. cholo 
5 Burt, C. “Validating Test. 


5 for Personnel Selection," British Journal of Psy 
vol. 34, Part I, p. 9, September, 1943. 


Criterion Measures 375 


are multiplied by the ratio of the standard deviation of the variable 
in the population to the standard deviation of the variable in the 
sample. 

COMBINING MEASURES WITHOUT USING AN OVERALL CRITERION. 
Some situations exist in which the separate criterion measures are 
to be combined to form a composite variable without using an over- 
all criterion as the dependent variable. This situation may arise 
either from an unwillingness on the part of the research worker to 
accept an available overall measure as a suitable criterion or from a 
lack of any such overall criterion. : ' 

An illustration is provided in the formulation of a composite 
criterion for yeomen. The areas of performance to be measured are 
proficiency (1) in typing, (2) in taking dictation, and (3) in filing; 
but none of the supervisors or peers available is sufficiently familiar 
With the individuals’ achievements in all of these areas to make an 
Overall appraisal of the yeomen's proficiency. Each of these areas, 
however, can be measured reliably by suitable performance tests, 
and these test scores can then be combined to establish a composite 
measure of success as a yeoman. The actual procedure would be to 
multiply each separate score by an appropriate value, or weight, 
which represents the relative importance of the area, and then to 
add the products for each individual. The weights to be assigned 
the separate measures in such cases can be determined by using 
(1) sets of rational weights based on the judged importance (or fre- 
quency of mention) of the separate areas, 3) the technique of 
maximizing the composite criterion variance (which results in maxi- 
mizing the internal consistency of the set of criterion measures), 
and (3) weights based on the standard deviations and the reliabilities 
of the Separate measures. 

The first procedure of assigning rational weights in terms of im- 
Portance involves combining the measures so that the rational 
Weights represent the actual effective contributions of the separate 
Measures to the variance of the composite" The nominal weights, 
Or regression weights, must then be determined so that the effective 
Contribution of the measures will be equal to the rational weights. 
"The solution requires the analysis of a set of simultaneous equations 
Which express the nominal weights in terms of (1) the standard 
deviations and the intercorrelations of the measures, and (2) the 
effective or rational weights to be secured. 

The proper use of rational weights is an acceptable procedure for 
Combining measures. The chief weaknesses in the procedure are 
lack of recognition of the differences between effective and nominal 


? Horst, op. cit., p. 73. А 
т Richardson, M. W. “The Combination of Measures,” in Horst, op. cit., p. 383. i 
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eer Y 
weights, and failure to secure competent judges for derermining » 
rational weights. Combining instructors' marks, achiev eme na 
scores, and aptitude ratings through the assignment of "им anal 
weights is the procedure usually employed for ee a 
school grades. The usual rational weights for school патке ате та 
unity, so that the marks are averaged, or simple ratios as 1:2 n sis је 
Unfortunately, the rational weights often are assigned on the ba ed 
little or no evidence and rarely represent the actual combina en's 
The weighting system used in one of the reserve uM 
schools provides an example of this failure to consider the des hä 
of effective contributions of variables. The instructional sta itiple 
decided, by some undefined procedure, that the academic mu was 
(a weighted average of weekly marks and final examinations) Tig 
to be weighted 4 to 1 for the purpose of combining it with a nem 
of aptitude for service. Since no intercorrelations or total Và ratio 
contributions had been computed, it can be assumed that the as 
4:1 represents the judged relative importance of these two P hen 
values as measures of success in this midshipmen's school. But wer 
the relative contributions of the two measures to the compose . e 
determined, the effective weighting was 17:1. Because the rat! E is 
aptitude for service received such a low effective weight, the њи 05 
tion coefficient between the rating and the composite was en 7 mit 
and this low correlation was then considered as evidence [01 
ting the aptitude for service rating from the criterion. — 
The second procedure, of maximizing the internal consist jcult 
the dispersion of the composite scores, is computationally pi 
if more than three measures are to be combined. It is recomme 


; 5 i ne 
for use in the case in which the measures can safely be asst eren 
| s i 

be measuring the same thing, as would be true of three used 
radio code receiving achievement tes 


e 
ts. The method must in che 
cautiously since the solution depends upon the units in WP 

measures are expressed. 


If it can be assumed that 
the same thing and that the 
artifacts of the measures, 
standard deviations of tl 
But the generally applic 
bining of measures with 
develop reliable and d 


ої 


ential) 
all measures are measuring 655 5 


a 
differences in standard deviatio^? and 
weighting in terms of the reliabilit ere 
ne separate measures may be won com 
able procedure recommended for t! pr 
out the use of an overall criterion 15 jp de 
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iscriminating measures of telat » ie € 
pendent areas, (2) to determine the desired rational wei8 ch 


the pooled judgments of the relative importance of each a do 
judgments being obtained from carefully selected competent Ј i? 
and (3) to combine the measures so that the effective cont" qo? 
to the total variance will 


A та 
be in the same ratio as those of Фе 
weights. 
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Acceptability of Navy Criterion Measures 


The criteria of success employed in Navy schools and in the 
evaluation of job performance consist of grades or marks, scores on 
achievement or proficiency tests, and ratings. In the preceding 
chapters frequent mention has been made of each of these three 
types of criteria, and some of their defects have been pointed out. 
In this section each will be evaluated by the standards of an accept- 
able criterion which have been described in the early part of the 
chapter. 

Grapes or Marks. Grades assigned in naval schools are usually 
based on scores in essay or objective tests, observations of laboratory 
performance, or subjective evaluations of work produced. In some 
schools the job of evaluation has been taken seriously; in others it 
has been regarded as only a necessary evil of school administration. 

Grades at their worst have been found to lack all of the qualities 
of an acceptable criterion. Even in the best schools, grades usually 
lack one or more of these qualities. It was not uncommon, for 
example, to find schools giving grades of acceptable reliability which 
Were quite lacking in comparability and comprehensiveness. Since 
the schools did not receive instructions about how to grade until 
relatively late in the war, it is not surprising that such an uneven 
Job of evaluation was being done. Nevertheless, it must be admitted 
that grades in Navy schools as a whole fall considerably short of 
acceptable standards in measuring the achievement of trainees. 

ACHIEVEMENT ок Proriciency Tests. During the last year and 
à half of the war a large number of standardized achievement exam- 
Inations were introduced in the elementary enlisted schools; a few 
Were developed on the officer level. Advancement examinations were 
Prepared to assist examining boards in the construction of tests 
Which could be used to measure the outcomes of in-service training. 

hese examinations have been described in Chapters XV, XVI, 
XVII, and XVIII. 

Such achievement examinations were usually quite reliable, dis- 
Criminated well between levels of performance, yielded comparable 
Tesults from school to school, and measured knowledge or skills 
Pertinent to the school's objectives. Perhaps the chief question which 
Could be raised about these examinations is whether they were com- 
Prehensive enough. While an effort was made to build performance 
and identification tests wherever needed, the majority of tests were 
9f the paper-pencil type and almost certainly did not measure some 
Of the skills which the schools aimed to teach. In addition it should 

€ said that these examinations measured technical competence only 
and not the petty officer qualities often regarded as very important 
11 determining the success of the man on the job. 


4 


378 Follow-up Studies 


The increase in the acceptability of school grades as itis 
success through the use of standardized achievement n 
has been pointed out. In a few cases studied, the use of suc сме 
inations has resulted in an increase, ог а shift, in the predi in 
efficiency of the tests of the Basic Test Battery. ‘These аа 
validity coefficients probably can be traced to the improved bility 
tion of the objective being measured, to the increased relia e 
of the criterion, and to reduction in the effect of extraneous fact! i 

The effect of using Advancement. Examinations as MENOR. m 
job proficiency has not been studied. Presumably these d 
tions will improve the quality of the technical examinations "e 
structed by the examining boards; and when used in epe 
with more objective Practical Factor 'Tests, they should pro zeli 
iniproved measures of the job proficiency of enlisted person for 
Since the trade testing approach has been used by the Navy ade 
many years in advancing enlisted personnel from one pay x ical 
to another, the problem of improving the measurement of сест ues 
competence is primarily one of improvement of testing techniq 
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Ratincs. The evaluation of the job performance of subord! oth 
is routinely made in the Navy by tens of thousands of judge? ithe" 
officers and enlisted men. Enlisted men are given marks, am 
quarterly or on change of duty, for technical proficiency, 56“ out 
ship, ability to lead men, and conduct. Fitness reports, 1 ^ 
periodically for all officers, 
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petty officers have never received specific instruction in how to rate 
performance; consequently it is not surprising that the ratings in 
general fail to meet the characteristics of acceptable criterion 
measures, 

Statistical studies of the ratings indicate that they are lacking in 
discrimination, reliability, and comparability. Especially noticeable 
are the facts that most ratings are high and that the means and 
standard deviations of the ratings assigned by the many different 
Judges vary considerably. Although there is less statistical evidence 
on the pertinence and comprehensiveness of the ratings, there are 
indications that they are based heavily on observations of personal 
qualities and less on technical competence. Because of numerous 
deficiencies, the present ratings of quality of job pipe 7 
not constitute acceptable criteria of success for use in research 
studies. Ф 


Summary 


The characteristics of an acceptable criterion, the problems en- 
countered in the development of such a criterion, and an evaluation - 
Of criteria used in the Navy have been presented in this chapter. 
This discussion has indicated that there is no simple solution to the 
problem of developing an acceptable criterion; procedures which in 
one situation lead to an acceptable criterion may not result in accept- 
able measures in another. The development of an acceptable cri- 
terion is, in actual practice, accomplished by a series of successive 
approximations. First, there is usually an attempt made to secure a 
reliable measure of individual differences in a broadly defined area 
ОЁ performance. Next, the definition of what constitutes success is 
clarified, stated more precisely, and new studies are made. As a 
result, improvements in the characteristics of the criterion may be 
effected over a period of time. This process may be continued until 
ап instrument is developed which reflects with a satisfactory level 
of acceptability how well the individuals measured actually perform 
9n the job. 

The problems described in this chapter are nowhere more acute 
than in the development of an acceptable criterion of shipboard 
Performance. In such a criterion the variations in the type of popu- 

, "lation, in the nature of work done, and in the standards of success 
encountered tend to be maximized. The problems of definition, of 
accuracy of measurement, and of comparability of units are particu- 
larly troublesome. The problems actually encountered in the devel- 
Opment of a criterion of shipboard performance, and the techniques 
used in attempting to solve some of these problems constitute a 
Major topic of the next chapter. 


CHAPTER XX 


PREDICTION OF PERFORMANCE OF ENLISTED 
PERSONNEL ABOARD SHIP 


Ir is generally agreed among personnel research workers that ee 
validity of prediction variables should be investigated by correlating 
them with success on the job. In the Navy during the war it was 
necessary to limit validity studies almost exclusively to determining 
the relationship between prediction variables and success in train- 
ing. The results presented in earlier chapters indicate that valuable 
information concerning the usefulness of classification data were 
obtained in this manner. To the extent that success in training 1$ 


related to job success, these studies showed indirectly the relation- 
ship between prediction variab 


les and performance on the job. 
"There was a strong desire, how 


€ver, on the part of those concerned 
with the Improvement of classification and training procedures to 


conduct studies showing the relationship between various classifica- 
tion and training data and performance aboard ship. In this chapter 
are presented the results of a pilot study conducted to determine 
the relationship between certain data on the Enlisted Personnel 


Qualifications Card and the quality of performance aboard ship of 
men in six enlisted ratings. 


NATURE OF SHIPROARD Р 
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other hand an average operator who is well liked may be a source 
of inspiration and encouragement to the others to do their best; 
thus he increases the efficiency of the team. 


Population Studied 


The sources from which a particular ship may receive men are 
similar to those for advanced service schools. The men may be sent 
to a ship direct from a recruit training station, from elementary or 
advanced schools, or from another ship. As a result of these multiple 
sources, the men in a single rating group can be expected to be quite 
heterogeneous with respect to amount of Navy experience, extent 
of civilian education and of civilian occupational experience, age, 
and scores on the Basic Test Battery. Since experience can be ex- 
pected to influence an individual's performance, it would be desir- 
able to have each sample limited to men of a given amount of Navy 
job experience (or in the rating, as it is termed). Because the rating 
groups available for this study were 50 small, it was necessary to 
include nearly all available cases. The only limitation imposed was 
that neither men of less than six months shipboard experience on 
the job nor those of more than fifty months experience in rating 
Were to be included. Since this range of experience included the 
larger percentage of men in the Navy during the war, it is considered 
that this sample is sufficiently representative of the Navy population 
With respect to length of experience. 

SAMPLE DzsicN. In order to include in this pilot study the major 
Sources of variation which might influence performance in ship- 
board duties, the sampling design was made to include ships of 
different types, men in different pay grades within a given rating, 
and several different ratings. Six parallel studies, each concerned 
With a specific rating, were therefore conducted. simultaneously in 
three types of ships. The six ratings, radioman (RM), signalman 
(SM), radar operator (RdM), fire controlman (FC), machinist's mate 
(MM), and gunner's mate (GM), were selected so as to sample both 
deck and engine room, both operating and maintenance ratings. The 
three types of ships chosen were destroyers, carriers, and large ships 
(two types of cruisers, and one battleship). For convenience the latter 
will simply be referred to as cruisers (designated CL) since only one 
rating group was studied aboard a battleship. 

RATING Grours Оѕер. A total of 120 groups from 27 ships (9 
destroyers, 12 carriers, and 6 cruisers) was studied. The groups in 
each rating were distributed as follows: 21 groups of radiomen, 15 
groups of signalmen, 22 groups of radar operators, 14 groups of 
fire controlmen, 29 groups of machinist's mates, and 19 groups of 
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gunner’s mates. Each rating had at least two groups in each ship 
type, except that no fire controlman or gunner's mate groups wer 

secured from the carriers. Because intact experienced groups had to 
be studied, the number of men in each group was small, the — 
number of cases per group ranging from 15 for signalmen pd - 
for gunner's mates. The actual numbers in the groups ranged pote 
6 signalmen on a destroyer to $3 radar operators on a cruiser. Т = 
number of ships by type, number of cases by rating, and total num 

ber of cases included in the study are shown in Table 1-хх. The 
ships used were those which (1) were available in West Coast ports 
between June and August 1945, (2) had engaged in combat or 


TABLE Lxx. Distribution of sample population by ship type and 


by rating аи es 
Number of Cases by Rating 
Type Number Number GM 
of Ship of Ships of Cases RM SM RdM FC MM 
Destroyer 9 460 72 12 97 75 87 187 
Carrier 12 682 172 104 194 212 156 
Cruiser 6 726 122 80 94 144 198 


All ships — 27 1,888 8656 198 3865 219 427 295 


number of combatant ships in the № 
in this study. 


Predictive Factors Studied 
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Factors Nor ASSOCIATED WITH Navy EXPERIENCE. These variables 
may be summarized as follows: 


1, Scores on the following tests of the Basic Test Battery: General 
Classification Test (GCT), Reading (READ), Arithmetic (ARI), Mechan- 
ical Aptitude Test (MAT), Mechanical Knowledge Test (Mechanical 
Score) (MKM), and Mechanical Knowledge Test (Electrical Score) 
(MKE). The special tests of the Basic Test Battery were not included 
because an insufficient number of scores was available. 

2. Age, as given by year of birth. This factor was included because for 
a number of ratings, age qualifications are specified. 

3. Civilian education, as defined by highest grade completed. The 
amount of civilian schooling is a variable which has frequently been 
listed as one of the qualifications for success in particular ratings. 

4. Civilian occupation, classified as managerial, clerical, mechanical, 
or miscellaneous with two levels of amount of experience in each cate- 
gory—level 1, one to four years of experience; level 2, more than four 
years of experience. Less than one year of experience in any job was 
listed as a separate level. | 

5. Classification interviewers’ judgments, as reflected in the assignment 
of quality classification codes and elementary school recommendations 
(i£ made at the recruit training station). These have been described in 
Chapter III. 


| FACTORS ASSOCIATED WITH NAvy EXPERIENCE. Besides the variables 
listed above, the study included a number of other factors which 
are related to performance aboard ship. These variables are: 


L Elementary school training, as contrasted with non-school training. 
The number of records showing data on advanced service school success 
Was too meager to permit an investigation of their relation to shipboard 
performance. 

2. Time lost between school and assignment to duty. 'These data were 
тах only for the purpose of aiding in the interpretation of other 

ata. 

я 3. Navy experience in rating and Navy experience not in rating. An 
individual who has been engaged in radio work for a period of several 
months would be expected to be more proficient than an individual 
who had not had this amount of practice. Also, the fact that a man has 
been aboard ship for a period of time should be of some advantage 
when he becomes a “striker.” The latter factor was, however, not in- 
cluded in the statistical analysis. ' 

4. Pay grade. This variable may influence performance aboard the 
Ship since the job assignments within a rating are often made in terms 
of the pay grade hierarchy. A signalman striker, for example, will rarely 
be allowed to send or receive flashing light messages on large ships re- 
Bardless of his ability because these duties are usually the prerogative of 
the third class signalman. 
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5. Effort put out by men on the job, as estimated from comments of 
supervisors. The meaning and significance of these comments are not easy 
to assess. The comments may indicate merely that individuals with good 
work habits were liked or were wanted by their supervising petty officers, 
or that the men who were liked were also said to have good work habits. 

6. The length of time aboard a ship. This variable is a possible pres 
tige factor which may influence evaluational judgments, since a super- 
vising petty officer may be tempted to rank higher the one of two equally 
competent individuals who has been aboard the ship longer. 


Sources or РАТА Состер. The sources of the data included 
in this study were (1) the enlisted personnel Service Records which 
are filed aboard the ship with a duplicate copy in the Bureau of 
Naval Personnel, (2) the Enlisted Personnel Qualifications Card 
prepared by classification interviewers at recruit training stations 
and at advanced classification centers, and (3) the division officer $ 
and chief petty officer's records. The data were collected either by 
the investigators themselves or by yeomen and classification inter- 
viewers not attached to the ship. This procedure resulted in a high 
degree of uniformity in the recording of the data, reduced clerical 
errors, and facilitated statistical processing. 

The Enlisted Personnel Qualifications Cards were the only source 
of information concerning test scores and occupational experience 
data. Since all of the men had not been processed by the standardize 
classification procedures, some of the cards lacked scores on the Basic 
Test Battery, the civilian occupational codes as recorded were "Ot 
always directly comparable, and the cards included notes апа 5р6 
cial test scores which were meaningful only to the classification unit 
preparing the original cards. Furthermore, Qualifications Cards рї 
pared at advanced classification centers either contained nO pn 
scores or had only General Classification Test scores and, in а few 
cases, Arithmetic and Mechanical Aptitude Test scores, The fail Y1? 
to file duplicate copies of these Qualification Cards in the Bureau 
of Naval Personnel and the conception of these cards as non-offic!? 
personnel records, separate from the Service Records, resulted s 


losses of data through careless handlin and ‹ lack 

А S storage. The JaC* . 
Qualifications Cards reduced greatly is number of usable cases у 
the statistical analysis of the data. 


The Criterion of Shipboard Performance 


One of the most challenging problems encountered in this stud 
was the development of an adequate criterion of shipboard a 
formance. Cursory inspection led to the conclusion that nO $ (ба. 
factory ready-made criterion was available. Quarterly marks ¢ 
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proficiency in rating, seamanship, mechanical ability, ability as a 
leader of men, and conduct) were not sufficiently discriminative. 
Speed of advancement in rating was felt to be dependent upon too 
many irrelevant administrative factors to serve as a valid index. The 
paragraphs that follow will describe the development of a criterion 
of shipboard performance and the gathering of the criterion data. 

PRELIMINARY PLANNING. In the planning stages of the project а 
number of decisions were made which defined the general character 
of the criterion to be developed. 

First, it was decided that, in addition to seeking an overall meas- 
ure of the quality of shipboard performance, a special effort should 
be made to secure a measure of a man’s ability to do his job when 
he applied himself—his technical competence, as it was termed, irre- 
spective of his personal qualities of leadership, dependability, etc. 
This decision was based on the fact that most of the objective indices 
used in selection and classification of enlisted personnel are designed 
primarily to predict technical competence rather than personal 
qualities, and that technical competence would therefore be the most 
useful criterion for evaluating the available prediction variables. 
In thus placing major emphasis upon technical competence, the 
assumption was made that technical competence is a significant 
factor in overall shipboard performance. Some evidence was ob- 
tained substantiating this assumption, although the matter was not 
submitted to rigorous test. 


Second, it was decided not to аатп : ‹ l r 
measures to men aboard ship. Administratıve difficulties and dif- 


ferences between ships, as well as lack of time, precluded the possi- 
bility of developing and using a set of trade tests. 

Third, the use of ratings by peers or associates was ruled out be- 
cause it was believed that a true "peer" situation does not exist 
within the ratings, stratified as they are by pay grade from seaman 
second class up through the various petty officer categories. 

Fourth, it was decided that the judgment of supervisors offered 
the most promising possibility for development of satisfactory cri- 
teria. Later experience bore out the initial hunch that, of the pos- 
sible observers aboard ship, those best qualified to judge the men’s 
effectiveness, particularly in the very important matter of having 
adequate opportunities for observation, are the supervising petty 
officers. Experience also indicated that these petty officers did not 
ordinarily have access to the data on the selection variables. 

Within this general framework, tentative procedures were set up 
and progressively refined on the basis of a series of experimental 
try-outs, in order to answer two crucial questions concerning the 
criterion: 


dminister objective achievement 
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i n 
1. Can a satisfactory degree of agreement be obtained betwee 
two supervisors responding independently? 


i i i ri ects 
2. Can supervisors differentiate effectively between various asp 
of performance aboard ship? 


PRELIMINARY EXPERIMENTATION. In the course of five or six pom 
of intensive experimentation aboard eleven ships returned ~ 
combat for repairs, the three following observations were mac tt 

1.-In general, rating scales proved relatively ineffective. Respo 2 
ents apparently used such dissimilar standards that their eet dis 
3- and 5-point scales showed sizeable differences in means : : 
standard deviations, and a low degree of correlation between none 
by pairs of judges. This phase of the study was not exhaustive; н 
fact, late іп the study а promising lead was found that might 
refined to yield a satisfactory scale. cm. Wat 

2. An adaptation of the “nominating” technique was tried, 4 
it seemed to be ill-suited for this particular situation. Petty ади 
were asked to name the enlisted man whom they would most li M 
and least like to take with them if they were transferred to навит 
ship as the leading petty officer of their rating. They were pe 
asked to state the reasons for their choices. In the time devoted 
such efforts, it proved impossible to secure una 
While continued effort might have produced 
ment in the caliber of results obtained throu 
following observations, whic! 
would have to be considered 
respondents: (1) A sizeable pr 
viewed had great difficulty in 
yielded practically nothing; со; 


у heir 
a check list developed from d 
own responses. 


3. Order-of-merit rankin 


sang 
88 appeared to be the most ртопиз то . 
the techniques utilized. Pe 


А in 
tty officers experienced little difficulty 


out the ranking, presen 
to be ranked, defini 
ranked, requiring 


requesting the respondent 


= АЕ 
THE CRITERION ADOPTED. The criterion used in gathering 


b 


® 
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data consisted of order-of-merit rankings in three areas: petty officer 
qualities, technical competence, and overall desirability. A high 
quality petty officer was defined as one “who obeys orders willingly, 
has initiative, takes responsibility, tries to do a good job, supervises 
men well, gives orders well.” A poor quality petty officer was defined 
as one lacking these qualities. Technical competence was defined as 
“What a man knows about his job, what he can do when he really 
tries; not how he gives and takes orders, not his petty officer quali- 
ties.” Specific definitions of “what a man knows about his job” were 
prepared for each of the six ratings. In the case of fire controlmen 
for example, the following four points were stressed: operation; 
checks and inspections; trouble shooting; and repairs. By thus 
placing emphasis upon specific aspects of performance it was possible 
to insure uniformity in the definition of technical competence from 
judge to judge and ship to ship. 

Overall desirability was defined as follows: “If you were trans- 
ferred to another ship from the one you are now on and were to be 
the senior petty officer, you would be interested in both the petty 
Officer qualities of your men and their ability in rating. Considering 
both petty officer qualities and ability in rating, which one of these 
men would you most want to take with you if you were transferred 
to another ship? Which man would be of greatest value to you?” 
After the judge selected the best man he was asked to select the next 
best man and so on until all men in the group had been ranked. 

In order to facilitate the data gathering process the definitions 
were written on cards so they could be read to the judge before 
he undertook to rank his men. Any questions which he might have 
were answered by the interviewer by providing further definitions 
or examples. 


While the study was underway, chec! 
obtained from eleven ships to determine the agreement between 


raters and the success with which supervising petty officers were able 
to discriminate between the three criteria: petty officer qualities, 
technical competence, and overall desirability. The rank-order corre- 
lation coefficient (rho) was used to determine these relationships. 
Checks on the agreement between judges in the technical com- 
petence rankings showed a median rho of .80. Those on petty officer 
qualities and overall desirability yielded a median rho of .60. In 
every rating the technical competence median rho was higher than 
the median rho for the petty officer qualities and overall desirability 
rankings. 

Checks on the discrimination among the three criteria showed a 
median rank-order correlation coefficient between petty officer qual- 
ities and technical competence of .80, indicating at best only a slight 


cks were applied to the data 
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degree of differentiation. The rank-order correlation epe E 
petty officer qualities with overall desirability ranged from ile 
91, and those for technical competence with overall desirab1 І 
from .80 to .95. These values tend to be as high as the reliability о 
the separate rankings would permit. There was some igen 
for certain groups, particularly radiomen, and for that = 
rankings on all three criteria were gathered throughout the stu va 
In the final analysis of the data, however, the criterion used was th 


: . . S » be 
technical competence rankings adjusted by the procedure to 
described in a later section. 


Procedures Followed in Gathering the Data 


As stated earlier, the 
Ships which had return 
forward areas for оуетћ 
cedure were as follows: 


: та 
data for this study were gathered abora 
ed to the continental United States pei 
aul or repairs. The actual steps in the p 


| А A cecutive 
1. The project was explained to the commanding officer or execu 
officer or both and arran 


k м ting 
Bements made for the time and place for pee 
the supervising petty officers in each rating. Usually the executive o e 
in consultation with the division officers selected the two judges who Y 


n 5 А ше 
best qualified to rank the men in the rating and arranged the sched 
for the interviewers. 


2. The names of the i 
pared 5” x 6” cards. Th 
and coding the followi 


ality 

H mei 

used in the ranking process, only the gam 
` £+ precaution which had to be obs 


í udg® 
" was explained to the l card 
as placed before him. A dat 
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was selected at random and placed on the table. A second card was 
picked at random and the judge asked “Is this man better or not as 
good as the first man?” If the reply was “better,” the card was placed 
above that of the first man; if the reply was "not as good," the card was 
placed below. This procedure was continued until all cards had been 
placed on the table in rank order. The judge was then asked to examine 
the rank order carefully and make any changes which he felt should be 
made. In order to assist the judge in the checking process the interviewer 
asked this question about a number of men, "Exactly why is A better 
than B?" The interviewer then recorded these ranks on the backs of 
the data cards. " 

5. A similar procedure was followed in getting the technical compe- 
tence rankings (the cards being shuffled before beginning the new 
rankings) As described earlier a card was prepared for each rating 
defining the nature of technical competence in that rating. During the 
ranking process, the judge was periodically reminded of the definition 
of technical competence and warned not to confuse petty officer qualities 
with technical competence. 

6. The rankings in overall desirability were obtained by substantially 
the same procedure as that used in (4) and (5) above. First the judge 
selected the man whom he would most like to take with him if trans- 
ferred to another ship, then the next best man, and so on until all the 
men had been placed in rank order. During the ranking process the judge 
was warned not to judge the men on a personal basis but on their overall 
value to the new ship. » А 

7. During the later stages of the study, ratings were obtained for each 
man in the group on a twenty point scale based on the Navy pay grade 
systemi—striker, third class, second class, first class. Each of these cate- 
gories was then divided into five steps. The following instructions were 
given: 


ade each man actually holds and consider only his 
ating in the Navy today whom you 
know. Select (the scale was placed before the judge) the number that 
Best fits your idea of each man’s ability. For example, a third class 
man may actually be better than most second class men in the Navy 
today; if so, he would be given a 14 or 15 on this scale; on the other 
hand a second class man may only be as good as the average striker 
and would be given a 3. The highest rating which you can give is 
20 and 1 is the lowest. 


Forget the pay gr: 
ability in terms of all men in r 


Although these ratings were not used in the final criterion, they consti- 
tute a promising lead as to a type of rating scale which may prove useful 
in evaluating the performance of enlisted personnel. | : 

8. The judge was instructed not to discuss his rankings with other 
Personnel aboard ship and was given assurance that the data would 
be used for research purpose only. Р ; 

9. Steps 8-8 inclusive were followed with the second judge. 
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10. The background and experience data were copied on the data 
cards (described in 2 above) from the Service Records and the Enlisted 
Personnel Qualifications Cards. 


11. The ranks were converted to scale values by Hull’s method (after 
correction for unreliability of judgments as described in the next sec- 
tion) 1, the criterion values for the two judges averaged, and the data 
on the cards coded in order to transfer the data to IBM punched cards. 
The main statistical analysis was made by use of the IBM cards. 


Refinement of the Criterion Data 


The technical competence ratings which were accepted as the 
criterion measure for the statistical analyses in this study were con- 
taminated by two extraneous factors: (1) unreliability of judgments 
and (2) differences in Navy experience of the ratees, It seemed that 
more valid data on the relationship between background factors and 
quality of performance aboard ship could be obtained by reducing 
the effect of those factors. Therefore steps were taken to make the 
necessary statistical adjustments in the criterion measures. 


In all, 120 rating groups of men with a total of 1,977 cases were 
used in the study. The groups ranged i 


competence were computed for all groups. These rho’s ranged from 
-08 to .98 for the 120 Sroups, with median rho's for the six ratings 
ranging from .78 to .9], 

It was decided that only rating groups for which the judges were 
in substantial agreement would be used in the analysis. In a number 


сеп judges was confined to а 


І. if the rank-order diffe 

2. if the distribution of 
together with a discontinui 

3. if the comments of the ; indicated definite disagreement 07 
revealed reasons for anticipati i 


rence was greater than N/3, 
differences showed 


After such cases were eliminated, the 
cient was recomputed for 
retained for which the rho 


1 Hull, Clark L. Aptitude Testin 
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original 120 were eliminated in this way and 44 single cases were 
eliminated from 26 of the remaining 111 groups. After the elimina- 
tion of these groups and single cases, the median rho’s indicating 
agreement on technical competence ranged from .84 to .91 for the 
six different ratings. 

For any measure of performance, positive correlation between 
amount of experience on the job and the criterion of success would 
be expected because of the increase in opportunities for learning 
associated with longer service and more responsibility. Median rank- 
order correlation coefficients between number of months of ex- 
perience in rating and technical competence values varied from .48 
for the fire controlman groups to .69 for the radioman groups. Since 
the relative degree of success of the men, independent of the length 
of time they had been in rating, was the criterion desired, an ad- 
justed criterion score was secured by partialling out experience from 
the technical competence values. 

The general procedure was to estimate the correlation coefficient 
between months of experience in rating and the technical compe- 
tence scale values. The regression coefficient corresponding to this 
correlation coefficient was then used to adjust each person’s technical 
competence scale value in such a way that his relative standing on 
the adjusted value scale would be independent of the amount of his 


experience. Р . 

Through applying the equation for the regression of technical 
competence values on experience, predicted values were obtained. 
The distribution of these values represented the variations in tech- 
nical competence scale values that could be attributed to the varia- 
tions in experience in rating. When these adjusted values, taken as 
deviations from the mean, were subtracted from the corresponding 
obtained technical competence scale values, also expressed as devia- 
tions from the mean, the result was the desired adjusted technical 


competence scale values.” 

In the solution of this particul i 
made separately for each ship group !n eac 
coefficients used in making the adjustment 


rately for each such group. | 
It was not considered appropriate to use the average values for al 


ship groups for a single rating because tests of homogeneity revealed 
greater than chance differences between ship groups both with 
respect to the variance of months of experience 1n rating and with 
respect to the correlation coefficients between experience in rating 


and technical competence values. 


ar problem, the adjustment was 
h rating. The correlation 
were also estimated sepa- 


2 The use of this technique assumes а zero correlation between test scores and ex- 


perience, This ари ках арро ОКА Ч ААМ s 
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The correlation coefficients between experience and technical 
competence that were used in making the adjustment were them- 
selves adjusted values. The adjustment was made as follows. The 
correlation coefficient between (1) standard deviation of months of 
experience and (2) the correlation coefficients of months of Expe- 
rience with technical competence were determined for all ships 1n 
each rating group. The correlation for experience with technical 
competence was then adjusted for each ship so that it would fall on 


the regression line at the point corresponding to the actual expe- 
rience standard deviation of the ship. 


Adjusted technical competence values, consisting of the residuals 
with the influence of experience held constant, constitute the final 
criterion developed. 

EVALUATION or CRITERIA ADOPTED. The criterion finally adopted 
possessed both strengths and weaknesses. The criterion stands Up 
well in the following respects: First, it has what may be termed 
"face validity". The judgments were requested on the actual per- 
formances for which the men had been selected and trained, and 
judgment of petty officers is used regularly in the Navy in evaluating 
personnel. The particular petty officers interviewed in this study 
were in a position to observe the subjects and had good reason to do 
so aside from the study itself. Second, the criterion was reasonably 
stable—two or more qualified observers agreed to an extent roughly 
comparable to the estimated reliability of the selection variables: 
Third, the criterion is reasonably uncontaminated with regard (0 
the selection variables—there is no reason to suspect that the judges 


were familiar, except in a very. general way, with the classificatio? 
and training data on their men or that they were interested in the 
specific outcomes of the study. 


On the other hand, certain definite limitations should be recog 
nized: First, evidence is lacking as to the degree to which petly 
officers’ judgments on achievement correspond to individuals’ act"? 
performance on objective measures of such achievement. second 


the data are not comparable from ship to ship, necessitating а © 
pletely “within ships” i 


analysis with very small numbers. It sho" 
be noted, however, that this difficulty is not a function of the ranking 
method per se but simp 


1ethod ly reflects the absence of any systematic PY” 
vision in the Navy for 


5 acific 
Supervisors to observe the work of spec 
men on more than one shi 


ont 


ur : ; this limitati 
analysis involving the variance of the с 


sing 
greatly the computational labor requir | 


riterion, thereby panel 
ed in the analysis and C 
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plicating the problem of estimating the reliability of the statistics. 
Fourth, no differentiation was obtained between petty officer qual- 
ities and technical competence. Evidently the technical competence 
rating obtained was in reality a sort of overall rating including 
personal qualities as well as technical proficiency. 


Analysis of Relation of Criterion to Predictive Variables 


The results of this study can be grouped into two major categories. 
First are the statistical data which describe the population used in 
this study; second are the data showing the relationship between 
background factors and criterion. Before presenting the results, a 
brief description of the statistical procedures used in analyzing the 
data will be given. 

STATISTICAL PRocEDUmrs. The statistical procedures used in ana- 
lyzing the relationships between background factors and the ad- 
Justed criterion values (variance due to experience eliminated) were 
chiefly correlational analyses and chi-square tests. Each of the pro- 
cedures is listed and described briefly below. 


у 1. Rank order correlation coefficients (rho's) were used in the рге- 
liminary analyses of the criterion, while product-moment correlation 
coefficients were computed after the criterion values were expressed in 
average linear scale values. These product-moment coefficients, termed 
within-group correlations, were computed separately for each ship rating- 
group. 

2. A single value representative of the within-group correlations was 
determined for each rating from the weighted average correlations found 
between two variables, using the Z transformation technique. The 
Separate Z-values were weighted by an appropriate number (N-3) in 
determining the average Z-value. The bias in the mean Z-value is not 
great enough to warrant the use of correction procedures in this study.? 

3. 'The hypothesis that the samples from which the correlations be- 
tween two variables were determined could have come from equally 
correlated populations was tested in each case in which an average 
within-group correlation coefficient was determined. This hypothesis was 
tested by determining the variance of the weighted squared deviations of 
the Z's from the mean of the Z-values for the several groups being com- 
bined. The test of the hypothesis is based upon the chi-square distribu- 
Чоп of the quantity E(N-8)Z? — OA summed over the set of 
затпр]ев а This test and the averaging of Z-values should bé used when 
the number of samples is small compared to the average size of the 
" aoe Paul R. An Introduction to Modern Statistical Methods, p. 106. John Wiley 

à mis New York, 1939. 

» op. cit., p. 107. LL 
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sample, a condition which was not generally obtained in this ps» 
rigor of this test in indicating whether the null hypothesis E aui 
accepted or rejected is that of the chi-square test and may not 
ciently sensitive to obtained differences. -— 
4. Product-moment correlation coefficients based on all cases comin 
in a single group were also determined between a selected number n 
variables and the criterion values for the particular ratings. Cod 
of the average within-group validity coefficients with these combine 
data coefficients indicate the extent to which variation in the pend 
of the groups on the prediction variables affects the correlation coet- 
cients. = 
5. The chi-square test, assuming the null hypothesis, was used to m 
vestigate the relationship between the criterion values and such eate 
gorized variables as interviewer's quality classification code, elementar) 
school recommendation, civilian occupation, and estimated level ne 
effort. The relationship of the latter to the criterion was also tested by 
means of the coefficient of contingency. г раў 
6. The relationship between the type of training and the о 
criterion values was analyzed by two procedures for each rating: (1) Ч 
the biserial correlations between the type of training (school or on 
school) and the criterion values, and (2) by a co-variance analysis of t 
differences in mean criterion scores of school and non-school traine Я 
groups. For this analysis, the two groups in the rating were equated 17 
terms of mean score on the one test of the Basic Test Battery which co! E 
he criterion for that rating. The ratio of the numbe? 
the two groups (school and non-school) for each shi 


onstant by selecting random samples for each group 
f tables of random numbers, 


of cases in each of 
sample was held c 
through the use o 


E od Е ће 
The distribution of а 


an 
groups, 15 for signalman, 16 for radar", 
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the lowest scores in these tests are made by the gunner's mates. 
Radiomen, radarmen, and fire controlmen are very similar with 
respect to amount of civilian education; gunner's mates have the 
lowest average number of years of education. With respect to age 
the signalmen and radiomen are the youngest and radarmen and 


TABLE 2-xx. Mean score on three selection tests, mean age, and mean 
number of years of civilian education by ship type and by rating for the 
sample population ! 


Mean Test Score Mean Years 
MeanAge Civilian 
Rating ShipType ССТ ARI MKM in Years Education 
RM Destroyer 59.4 51.0 50.4 21.9 11.0 
Carrier 53.4 49.2 49.2 21.5 11.1 
Cruiser 54.0 46.6 45.9 21.7 11.2 
Total 53.3 48.8 48.8 21.7 11.1 
SM Destroyer 48.0 41.4 47.2 22.9 10.7 
Carrier 49.9 46.8 46.6 21.5 10.5 
Cruiser 52.0 47.6 46.4 21.2 10.7 
Total 50.9 47.1 46.6 21.5 10.6 
RdM Destroyer 54.4 50.6 48.0 26.0 11.4 
Carrier 52.9 50.6 52.0 25.6 115 
Cruiser 54.1 52.1 50.9 24.5 11.8 
Total 53.7 51.1 50.7 25.4 11.4 
FC Destroyer 58.8 58.2 56.5 23.4 114 
Carrier No Cases 
Cruiser 54.4 58.8 58.6 23.7 1:5 
Total 56.2 53.3 54.2 23.6 11.5 
MM Destroyer 50.3 47.9 53,5 24.1 10.3 
Carrier 50.4 48.4 54.7 24.5 10.6 
Cruiser 51.4 48.6 56.8 23.7 10.7 
Total 50.6 48.4 55.1 24.2 10.5 
GM Destroyer 51.2 46.3 53.6 23.6 10.2 
Carrier No Cases 
Cruiser 44.2 42.0 45.8 23.5 9.3 
Total 46.6 43.4 48.8 23.6 9.7 


1 The mean values in this table are based upon differing numbers of cases. All avail- 
able data for these variables were included in the computations. ‘ 


machinist’s mates are the oldest. In general it appears that this popu- 
lation is fairly representative of rated men in the Navy. 
RELATIONSHIP OF EXPERIENCE TO THE CRITERION. In the discussion 
of the development of the criterion it was stated that there was a 
Substantial relationship between experience and the average tech- 
nical competence scale values and that these scale values had to be 
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adjusted for differences in amount of experience. The баа. - 
cerning average amount of experience and variability in paana 
by rating and ship type are shown in Table 3-xx. Aboard destroyers 
the machinist’s mates are most experienced, while aboard carriers 


and cruisers and in the combined group, radiomen are most €X- 
perienced. 


TABLE 3-xx. Months of experience in rating by type of ship for six 
ratings: means and standard deviations of distribution 


Destroyer Carrier Cruiser All Ship Types 


Rating N M o N M o N M o N M c 
RM 72 194 828 172 208 928 122 234 
SM 12 195 878 104 186 7.46 82 
КЕМ 77 146 429 194 166 5.01 
FC 75 189 7.76 


8.38 366 214 p9 
19.0 8.91 198 18.8 ue 
94 165 735 365 161 5 


No Cases 144 197 733 219 194 ге 
ММ 87 226 959 212 168 751 128 195 917 497 188 oh 
SM 187 215 904 No Cases 156 170 890 298 191 9. 


The coefficients of correlation betw 


een amount of experience and 
the criterion are shown in Т. 


able 4-xx. It should be noted that these 
are average within-group coefficients; in the case of radiomen, fo! 
example, the correlation is the average of the twenty-one which were 
computed for this group. All of the correlations are quite high and 
indicate that there was a strong tendency for the most experience 
men to get the highest ratings, thus substantiating the contention 
that the criterion values should be adjusted for experience. 


TABLE 4-xx. 


B H . H n 
Average within-group correlation coefficients betwee 
months of ex 


H H B B e 
perience in rating and unadjusted technical competere 
average scale values for six ratings 


— == 
Average 
: Number Number P-valuei Correlation 
Rating of Ships of Cases (Homogeneity) Coefficient 
RM 21 366 50-70 69 
SM 14 198 zc t 69 
RdM 20 365 <1% .52 
FC 13 219 2-597, 48 
MM 26 427 1-2%, 65 
GM 17 293 <1% 55 


n p * sis 
1The values in this column were obtained from a chi-square test of the hypoth 


that all ship groups within a rating were rand 
populations. The P-value indicates the probabi 
coefficients as large as was obtained would occur among such random samp: 
chance alone. 
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RELATIONSHIP ОЕ Basic Test BATTERY SCORES TO THE CRITERION. 
Average within-group correlations between the six tests of the Basic 
Test Battery and the criterion values were determined separately for 
each rating. These data are presented in Table 5-xx. The signifi- 
cance of each Z-value was evaluated in terms of its standard error; 
those values lying between the 1 per cent and 5 per cent levels of 
significance are in italics, those beyond the 1 per cent level are in 
bold face. This table indicates that the six tests of the Basic Test 
Battery tend to have significant positive correlations with the cri- 
terion. The one negative correlation, between the Reading Test 
and the criterion for gunner’s mates, was not significantly different 
from zero. 

The pattern of correlation coefficients in Table 5-xx is approxi- 
mately what one would expect. For radiomen, signalmen, and radar- 
men the verbal and arithmetical tests show the highest correlations 
with the criterion. In the case of gunner’s mates, machinist’s mates, 
and fire controlmen, the highest correlations are those, between опе 
or more of the mechanical tests and the criterion. In every rating 
there is at least one correlation over .30; in the case of radarmen one 
test (Arithmetical Reasoning Test) correlates .44 with the criterion. 
Although these correlations are not as high as those found between 
Basic Test Battery scores and success in elementary and advanced 
enlisted schools, they follow the same general pattern. Evidently the 
test scores can be used with some degree of success to predict quality 
of performance aboard ship. 

The correlation coefficients given in Table 5-xx are average corre- 
lation coefficients; that is they are weighted averages of the coeffi- 
cients obtained for the separate groups in each rate. The correlation 
of the General Classification Test with the criterion in the case of 
radiomen, for example, is the average of the thirteen coefficients 
computed for this rating. This procedure was followed because the 
Broups from the different ships differed significantly in average 
General Classification Test scores; hence it was felt that the thirteen 
groups should not be combined into one population and a single 
correlation coefficient computed between General Classification Test 
Scores and the criterion. 

In Table 6-xx are shown the correlation coefficients between scores 
on three tests of the Basic Test Battery and the criterion, computed 
by the “within-group” and "combined" techniques. Although the 
differences are not large, it can be seen that in general the correla- 
uon coefficients computed by the within-group technique are highest. 
Evidently combining the different groups into one population (by 
rating) results in general in an attenuation of the correlation 
coefficients. 
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nhi i : asic 
TABLE 5-xx. Average within-group correlation coefficients between Ba 
Test Battery scores and adjusted criterion values for six ratings 


Average Standard 
Number Total Consti Average! Eno = 
of Ship Number Coefficient Weighted За 
Rating Tests Groups ofCases with Criterion — Z-Value 2-У8 
RM GCT 13 175 38 403 = 
READ 12 196 33 338 te 
ARI 12 148 .82 335 "а 
МАТ 10 118 16 .158 E^ 
мкм и 195 26 270 1 ^ 
MKE 11 125 16 165 1 
SM GCT 7 97 31 317 - 
READ 3 33 02 026 и 
ARI 5 69 29 301 5 
MAT 4 57 81 325 1 
MKM 5 59 28 292 ae 
MKE 5 59 10 108 Jm 
кам GCT 17 261 31 320 m 
READ 16 298 26 271 E. 
ARI 16 234 "m .478 ay 
MAT 16 236 26 .268 07 
мкм 16 232 15 451 7 
: MKE 16 232 26 .260 Q9 
F GCT 8 154 23 .238 
READ 6 99 20 .208 = 
АВІ 6 199 94 253 10 
MAT 6 115 33 345 ^ 
MKM 6 100 19 193 A 
MKE 6 100 24 246 K 
MM GCT 19 236 .18 187 0 
READ 14 139 03 027 [^ 
ARI 14 159 25 251 09 
МАТ 15 158 13 130 а 
MKM 15 153 36 375 10 
MKE 15 153 31 323 9 
GM GCT 1l 166 15 150 j| 
READ 5 52 —.11 — 112 10 
"d 9 121. 27 .275 32 
MEN 5 83 .35 369 13 
MKE 74 36 375 13 
6 74 29 300 


of tbe 

atio ^ jn 

l'The significance of these average Z- -values Was evaluated in terms of tl 
average to its standard error, 


z; val yels 2 
italics, those beyond tha 1%, ee dei ri Mise the 1% and 5% le 
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The intercorrelations between three tests of the Basic Test 
Battery, age, and years of civilian education are shown in Table 
7-xx. The mean and standard deviation for each variable by rating 
group are also presented. In general the intercorrelations between 
the three Basic Test Battery scores are somewhat lower than those 
reported in Chapter VI, probably because these groups have been 
selected in part on the basis of test scores and show somewhat less 
variability than a recruit population. 

RELATIONSHIP BETWEEN AGE AND THE CRITERION. As shown in 
Table 8-xx there is a low but significant correlation between age and 
the criterion for the radioman, radar operator, machinist’s mate, and 
gunner’s mate groups. The mean age and standard deviation for 


TABLE 6-xx. Comparison of the correlation coefficients between scores 
on three tests of the Basic Test Battery and the criterion for six ratings, 
computed by the combined group and average within-group procedures 


"Test 

Number a 

Rating Method of Cases сст ARI MKM 
RM combined groups 156 33 18 .09 
within-group varied 38 32 .26 
SM combined groups 96 22 24 .23 
within-group varied 31 29 .28 
RdM combined groups 248 29 39 2 
within-group varied 31 44 15 
РС combined groups 117 25 25 18 
within-group varied :28 24 19 
MM combined groups 206 16 21 31 
within-group varied .18 25 .36 
см combined groups 124 17 16 .29 
within-group varied 15 27 .36 


each rating are shown in Table 7-xx. Although age requirements 
are frequently specified for various billets, there is little evidence 
In this table to indicate that this factor should be given serious 
consideration in the assignment of men, at least not within the age 
range of the men included in this study. 

RELATIONSHIP BETWEEN AMOUNT OF EDUCATION AND THE CRI- 
TERION. The means and standard deviations of years of civilian edu- 
cation of men in different ratings are shown in Table 7-xx. The 
relationship between years of education and the criterion values is 
shown in Table 9-xx. These average within-group correlations range 
from -01 for radiomen to .27 for signalmen. Whether these coeffi- 
cients represent anything different from the common abilities or 
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capabilities represented by the Basic Test Battery scores cannot ђе 
established from the data presented in this chapter. Data in Chapter 
VI and in Table 7-xx show, however, that there is substantial corre- | 
lation between Basic Test Battery scores and amount of npe) 
It does not seem likely, therefore, that amount of education woul 


p m ed 

"TABLE 7-xx. Intercorrelations, means, and standard deviations of e = 

variables computed for all cases іп each rating for which complete да 
on these variables were available 


Intercorrelations 


Years of 
Rating Number Agein Civilian 
Variable Group of Cases ССТ ARI МКМ Years Education M id 
GCT RM 156 60 29 E 96 522 1 
SM 96 56 30 10 64 50.5 847 
вам 248 68 — .35 34 38 535 gg 
FC 17 72 — 48 26 49 565 889 
MM 206 68 58 ‘06 51 496 ва 
GM 194 61 60 10 55 44.9 09 
ARI RM 156 60 36 21 18 484 005 
SM — 96 56 35 24 62 471 1069 
вам 248 58 31 325 33 510 — 1216 
FC 17 79 48 28 Al 541 1012 
MM 206 8 ла 03 39 486 м 
GM 124 ае 49 05 34 43.9 48 
MKM RM 156 29 36 27 до 482 95 
SM 96 — 30 35 36 47 464 0.25 
вам 248 53 31 29 109 508 1098 
FC 17 48 48 4l 30 543 072 
MM 206 58 44 25 49 551 027 
GM 14 50 49 24 49 490 а 
Agein RM 156 33 31 27 22 300 $a 
Years SM 96 10 14 36 M 21 627 
RdM 248 34 5 29 08 258 487 
FC 17 56 328 — а 48 — 297 — раб 
MM X6 05  . 9 55 —21 247 — 496 
GM 124 10 45 за —08 292 ig 
Civilian RM 156 96 18 09 29 12 — 19 
Education SM 96 — 64 62 17 14 10.8 151 
inYears — RdM 248 38 38 09 ‘08 115 150 
FC 107 49 4l 30 13 nó ул 
MM 906 5l 39 42 ә 10.6 215 
GM 124 5 34 42 о 94 


be a very useful selection device if 


: NS А tery 
: an individual's Basic Test P2 
scores are available. 


RION’ 
TRAINING AND THE Світе. for 
the purpose of preparing me! 


В Е w 
their shipboard billets. It is of interest, therefore, to know ho 
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TABLE 8-xx. Average within-group correlation coefficients between age 
in years and adjusted criterion values for six ratings 


Total Average r 
Number Number Average with Age 
Rating of Ships of Cases 71 с: in Years 
RM 21 366 148 . 06 15 
SM 12 186 „127 .08 12 
RdM 20 365 -190 -06 -19 
FC 13 218 .045 08 04 
MM 25 410 142 06 14 
GM 17 293 164 06 16 


1 The significance of these average Z-values was evaluated in terms of the ratio of the 
average to its standard error, с:; values lying between the 1% and 5% levels are in 
italics; those beyond the 1% level are in bold face. 


School trained men compare with non-school trained personnel in 
performance aboard ship. As explained in Chapter V, men who do 
Not go to school can acquire the necessary training to qualify for 
petty officer status through the in-service training program. It is 
conceivable that the latter type of training may be as good as or 
even better than training given ashore. Data were gathered in this 
study to throw some light on this question. 

A complicating factor in any study of the relationship between 
school training and success aboard ship is the fact that school popu- 
lations average higher in ability test scores—having been selected on 
that basis. Table 10-xx shows that the school trained personnel 
average higher in all tests of the Basic Test Battery than do non- 


TABLE 9.xx, Average within-group correlation coefficients between years 
of civilian education and adjusted criterion values for six ratings 


Average r 

Total with Years 

Number Number Average of Civilian 

Rating of Ships of Cases 71 с: Education 
RM 21 361 .009 -06 .01 
SM 12 186 .282 .08 27 
RdM 20 361 121 06 12 
FC 13 215 .232 .08 22 
MM 26 423 .196 05 19 
GM 17 291 .202 .06 .90 


1 The significance of these average Z-values was evaluated in terms of the ratio of the 
average to its standard error, g.; values lying between the 1% and 5% levels are in 
italics; those beyond the 1% level are in bold face. 
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TABLE 10-xx. Means and standard deviations of scores on three Basic 
Test Battery tests for school, non-school, and combined groups for six 


ratings 
Test 
GCT ARI. MKM 
Rating N M с N M с N M с 
School 145 557 7.60 16 498 910 105 487 850 
RM М5. 62 479 660 57 454 — 840 56 477 830 
Total 207 533 7.30 173 483 8587 161 483 843 
School 104 586 792 85 565 1052 7$ 577 1124 
FC NoSch. 71 526 919 58 485 1990 48 490 844 
Total 175 562 892 143 533 1192 121 543 988 
School 192 560 752 180 536 968 180 527 10.12 
RdM — N.Sch. 85 483 816 73 449 1012 72 458 908 
Total 277 537 852 258 511 10.60 252 507 10.32 
School 57 520 772 49 479 10.00 43 473 988 
SM  N.Sch 69 501 848 62 463 932 58 461 928 
Total 196 509 820 Ml 471 954 10 466 956 
School 194 548 770 93 522 1010 во 578 890 
MM  N.Sch. 145 470 830 120 455 900 14 530 990 
Total 267 506 802 213 484 948 203 551 946 
School 57 556 624 49 488 844 49 558 8:36 
GM — N.Sh. 140 499 844 100 409 784 a5 455 968 
Total 197 466 976 155 434 880 127 488 1048 


TABLE 11-xx. Means and Standard deviations of adjusted criterion 
measures for school, non-school, and combined groups for six rating 


School Trained Men Non-School Trained Men Combined GrouP 
Rating N M c N M a N M 2 
ЕМ 254 525 1844 II 4 1302 
SM 86 516 1374 a ka i we 


106 48, 5 К 
вам 249 525 pa m 454 po 192 M 1549 
ЕС 131 502 1536 80 488 1685 21ү 497 D% 
MM 132 318 1464 220 485 тебе аз 50 154 
GM 85 540 1579 | ў 7 а 152 


99 480 1476 284 49.8 
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school trained personnel are of higher quality as measured by ability 
tests. In Table 12-xx are shown the biserial correlations showing 
the relationship between attendance or non-attendance at school and 
success aboard ship. Actually Tables ll-xx and 12-xx present sub- 
stantially the same facts through different media—the first through 
difference in means, the second through correlational data. The 
biserial correlation coefficients as well as the mean criterion values 
are influenced by the fact that school trained personnel have higher 
ability test scores. 

In order to hold constant the factor of ability, a covariance test 
was applied to the data, equating the groups on the basis of the 
Basic Test Battery score correlating highest with the criterion. Appli- 
cation of the F-test (Table 13-xx) shows that the only difference 


TABLE 12-xx. Biserial correlation coefficients between school vs. non- 
school training and adjusted criterion values for six ratings 


Number of Cases 


а 


School Non-School 
Rating Trained? Trained Tors 
RM 254 111 34 
SM 86 106 12 
RdM 249 113 .28 
ЕС 131 80 05 
MM 193 220 14 
см 85 199 23 


: l School trained men attending any school other than one for the rating at which 
су were working were omitted. 


between school and non-school trained men significant at the 1 per 
Cent level is that in the case of radiomen. The difference for radar- 
men is significant at the 5 per cent level but not at the 1 per cent 
level. The smallest F-ratio occurred in the case of machinist’s mates. 

The relationship between success in elementary school and success 
aboard ship is shown in Table 14-xx. Elementary school success is 
measured in two ways—percentage grade earned and rank in class. 
Except in the case of signalmen, the correlation coefficients between 
rank in class and success aboard ship are higher than those between 
School grades and the criterion. This finding is in accordance with 
that usually found in civilian education. The relationships between 
School success and success aboard ship are substantial and indicate 


ns in general the men who do well in school also do well aboard 
ship. 
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TABLE 13-xx. Significance of differences in mean adjusted criterion b pre 
for school and non-school trained groups, equated on mean scores of te 
of Basic Test Battery correlating highest with the criterion 


Test 
Correlating 
Highest Number Number of Cases 

with of Ship — ^. Degrees of 
Rating! Criterion Groups School Non-School F-Ratio Freedom P-Values 
RM GCT 11 72 37 1161 land9 Р<1% 
SM GCT п 35 58 317 land9  P»59; T 
RdM ARI 15 126 27 6.64 Тапа 13 1%<P<5% 
MM мкм 5 70 39 1.15 Тапа13 P2596 


= | of 
1 No covariance test could be made on fire controlmen and gunner's mates because 
the small numbers of cases available. 


RELATION BETWEEN Erronr 
had completed the ran 
technical competence 


AND THE CRITERION. After the judges 
king of their men on petty officer qualities 
, and overall desirability, they were asked 2: 

abits and personal characteristics of the ирре! 


average in effort, (4) average 
worker, (6) hard Worker, 
work habits of the man. I 


codes assigned by coders 
cent of the cases. 


е m А мо 
TABLE 14-хх. Aver age within-group correlation coefficients between tV 


measures of school success and adjusted criterion values for six ratings 
Total 
School Number Number 

Rating Success Measure of Ships of Cases Average r Average Z = 
RM Grade 14 19] 40 425 a 
Rank in class 11 143 51 562 24 
SM Grade 2 24 52 572 ‘of 
Rank in class 2 20 34 -352 ‘08 
RdM Grade 15 199 .30 312 ‘08 
Rank in class 13 184 39 410 1 
ЕС Grade 8 95 44 470 38 
Rank in class 7 83 48 .528 a2 
MM Grade 10 94 25 251 13 
Rank in class 9 83 45 482 aT 
GM Grade 5 49 29 225 27 

Rank in class 2 20 29 295 
ee NE NE В 
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The relationship between effort (as coded) and the criterion 
(trichotomized at the one half sigma point above and below the 
mean) was determined by means of the coefficient of contingency. 
In the school trained groups, the contingency coefficients for the 
different ratings ranged from .28 to .51 with a median of .38; in the 
non-school trained groups, the coefficients for the different ratings 
ranged from .19 to .38 with a median value of .29. The coefficients 
in the combined groups ranged from .36 to .49 for the different 
ratings with a median value of .43. 

The meaning of the relationships between effort and the criterion 
are difficult to interpret. Although the relationship between the 
three criterion measures and the estimates of effort were not com- 
puted, there are strong indications that the effort ratings were actu- 
ally only different facets of the overall evaluations. In other words 
if a supervising petty officer thought well of a man he was likely to 
Say that the man was a hard worker; if he didn't like the man he 
was likely to say that the man was a poor worker. 

Отнек Facrons. The relationships of the following other factors 
to the criterion were also studied: civilian occupation, quality classi- 
fications and recommendations made by classification interviewers, 
time lost between school and assignment to duty, Navy experience 
not in rating, and length of time aboard a particular ship. Since no 
Significant relationships were found and since some of the data on 
the factors (notably information about civilian occupation) were of 
questionable quality, the results are not presented here. 


Summary 


The findings of this study can conveniently be grouped into two 
major categories: those pertaining to the criterion and those per- 
taining to the relationship between background factors and ship- 
board performance. Since this was the first systematic study under- 
taken by the Bureau of Naval Personnel of the relationship between 
Classification and training data and shipboard performance, it was 
necessary to do considerable experimental work on the development 
Of a suitable criterion. In many respects the major contribution of 
the study lies in the work which was done on the development of the 
Criterion measures and in "purifying" them for use in statistical 
analysis, 

DEVELOPMENT or A Crirerron. The high degree of agreement 
between supervising petty officers is the most significant feature of 
the criterion finally adopted. The relationships, expressed as rank- 
Order correlation coefficients, are considerably higher than those 
БепетаПу reported in the literature for independent rankings of indi- 
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viduals based on their performance on the job. While it is true that 
the supervisors had probably discussed the capabilities of the men 
in their groups, there is no evidence that they had ever actually €x 
pressed these judgments as ranks. Certainly there was по prior 
opportunity for the supervisors to compare judgments pertaining t° 
the evaluations requested of them in this study. 

The most disappointing aspect of the research on the development 
of the criterion was the inability of the supervisors to differentiate 
between qualities of personality (petty officer qualities) and technical 
competence. Every effort was made during the ranking process to 
emphasize the differences between these two variables. While some 
differentiation was apparently obtained in the radioman groups, the 
relationships between the two criteria tend to be as high as reliabil- 
ities would permit. This may be due to the fact that petty officer 
qualities and technical competence are actually so intimately 88805 
ciated that differentiation is really impossible. It may well be for 
example, that technical competence is the chief determiner of com- 
petence as a petty officer; on the other hand it may also be true that 
an individual will not be given opportunity to demonstrate high 
levels of technical competence unless he possesses correspondingly 
high petty officer qualities. If narrow segments of technical com 
petence had been studied (e.g., code receiving or sending in the ae 
of radiomen) it is possible that a lower correlation between petty 
officer qualities and technical competence would have been obtaine® 

In future studies it would seem imperative to experiment with the 
use of performance tests and check lists as criterion measures. Ја 
approach was actually recommended for use in the stud reported in 
this chapter; but due to the difficulties of admini ed such tests 
and check lists to personnel aboard ships i pee A r comba 
operations, the idea was abandoned — ргеразнів > pow 

ed. It should be pointed out,” о; 


ever, that this method also h i : jef oF 
ў i so has serious disad e chief 
being the differences between vantages, th I ds 


: : ships in type and тей” 
of operation and the differences in jobs н ir uem whe e 
in the same rating and pa d i = 
controlled would the da i ien. ње que c diana T 
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enlisted schools. Of special interest was the finding that the General 
Classification Test showed a significant correlation with the techni- 
cal competence of radiomen. Actually this correlation is higher than 
that found between General Classification Test scores and final 
grades in radio school. This can perhaps be attributed to the fact 
that radio schools emphasize ability to learn the code, while aboard 
ship the emphasis is placed on several factors in addition to code 
proficiency. Results of this sort if found in large numbers of cases 
aboard many ship types should be of real significance to classification 
and training. 

The data on the relationship between Navy training and ship- 

board performance are difficult to interpret. Unfortunately the 
number of usable cases was small and two ratings had to be omitted 
from the analysis because of small numbers of cases. While an 
attempt was made to equate the school trained and non-school 
trained groups on the basis of ability, there is no assurance that this 
procedure was completely satisfactory. In short, the findings must be 
interpreted with extreme caution despite the fact that the findings 
have some degree of plausibility. It seems reasonable, for example, 
that school training for radiomen should be more important than 
for gunner's mates. Opportunities for learning about the job aboard 
Ship appear greater in the latter case than in the former. 
. One reason for warning against generalization from these data 
is the fact that they were gathered aboard only relatively large ships 
—destroyers, cruisers, carriers and a battleship. On ships of this type 
there is usually a substantial number of experienced men who can 
fill the more responsible positions and assist in the training of new- 
comers, In other words, it may not make a great difference whether 
a man is school trained, when he has to start at the bottom anyway. 
On a small ship the situation is quite different; new men must fill 
Immediately positions of considerable responsibility. It seems quite 
likely, therefore, that school training may be very important for 
personnel being sent to small ships but of only minor importance 
for those going to large ships with experienced crews. This question 
should be made the subject of careful study, for there would be 
Important implications in such findings for the assignment of school 
trained men, especially in wartime. If school training is essential 
In the case of men going to small ships and of lesser importance 
for those going to large ships, cognizance should be taken of such 
à fact in periods such as prevailed during World War II when there 
always seemed to be too few trained men for the many billets to 
be filled. А 

A second reason for recommending caution in generalizing from 
these data is that the criterion employed falls short of desired stand- 
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ards. As stated earlier in the chapter, it was the aim of the p^ 
to determine the relationship between background factors E e 
criterion of technical competence. Since a high correlatior oni 
found to exist between the technical competence, petty-officer T те 
ties, and overall desirability ratings, there is grave doubt a 
acceptability of the criterion. Until other criterion data are aval un 
such as would be obtained from valid performance tests, it W aen 
be unwise to formulate any definite conclusions about the effecti 
ness or non-effectiveness of school training. . vith 
The low correlations of age and amount of civilian education ped 
the criterion are not surprising. It should, of course, not be а 
cluded that there is no relationship whatever between these - 
factors and performance aboard ship. It is important. to iq oi qe 
that the age range was primarily from 20 to 30. Within tit m 
range the relationship was very low; but if men up to 50 Jed 
age had been included, it seems likely that the relationship раја 
ћауе Ђееп Јатсег. Тће зате principle applies to amount of civi ile 
education. The majority of men included in the study had со 


P rma 
pleted 10, 11, or 12 years of education. If there had been a nor 
distribution in the amount of education, for ex 


years, there probably would have been a somev 
ship. It seems quite likely, however, th 
Battery scores are available, 
years of civilian education he 
ciency with which his success 
It is unfortunate that satisfa 


ample from 6 bn n 
vhat larger age n 
at if a man's Basic ny 
additional knowledge of how a da 
completed will not improve the 
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А Я іопа 
ctory information about occupa iay: 
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- Я 3 : Hence 
Differences in the coding procedures of occupational experien 


lack of occupational experience on the part of a large share rers 
younger men, and failure on the part of classification intervit the 
to record enough information about 


ces s e 
Е а man’s civilian job, made gs 
study of the occupational factor very difficult. As a result the fir 
in this study were entirely negative, 


While the data for this stud 


ру ti 
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able period of time, If and when these traits can be me 
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objectively, it seems likely that the efficiency of prediction of ship- 
board performance will be greatly improved. 

, The results of this pilot study indicate that research on the rela- 
tionship between background factors and performance aboard ship 
is feasible and that it can provide useful information for classifica- 
tion and training. The two major weaknesses in the study reported 
in this chapter are (1) the incompleteness of the data in the enlisted 
personnel records and (2) the inadequacy of the criterion of ship- 
board performance. The first weakness can be corrected by the 
Systematic testing and classification of all personnel in the Navy; 
the second will require intensive research over a period of time, 
leading to the development of more acceptable criterion measures. 


CHAPTER XXI 
INFORMATION SURVEYS AS EVALUATIVE DEVICES 


А igned 
INFORMATION SURVEYS is the title given to a series of projects ~ 
to determine and analyze the opinions of Navy men about eon 
aspects of training, educational programs, and Navy life. bee d 
ter is concerned with the use of this survey technique for the н «dán 
tion of personnel practices. The previous chapter was gonea no by 
part with the evaluation of selection and training proce ma dala 
analyzing the relationships between classification and nan S inae 
and performance aboard ship. In presenting the case for the inte 
tion of opinion surveys, it was pointed out that sur асва | data 
the general area of morale and attitudes could provide usetu pol- 
for the appraisal and improvement of personnel and training й 
icies. What the men think about their training, or the Loe the 
practices which affect their Navy life, may not correspond el the 
judgment of experts; but it is real to the men themselves. bee 
experts know the distribution and magnitude of these OP nich 
they are in a position to take practical steps to modify those У a 
appear to rest upon error or misconception or are for other теа 
regarded as undesirable. 
The three major opinion surveys w 
chapter represent only a very modest att 
area of attitude and morale. The first 
January 1945, and all three surveys we ‘tute 
bers who also had other duties. Nor do the three surveys const? ur- 
a coordinated program of research: each survey had a different Р to 
pose, and each, except for the first, was undertaken in respon? y 
a specific request. In spite of the different contexts of each ie dol 
there is enough overlapping in content and especially in me spect 
ogy to permit drawing a number of generalizations both with ТЄ die 
to the attitudes of Navy men and with respect to the values 9 eral 
tude research in evaluating personnel Practices. Before these ger inf 
izations are drawn, however, descriptions of each survey, COV" ре 
methodology, content, the plan of analysis, and major results W! 
presented. 
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tremendously; new schools were established, selection procedures 
were set up, new curricula were written, new instructors trained, 
new achievement examinations constructed. The experts had worked 
with all the resources at their command to do the best job they 
could. Now, what did the enlisted men who were put through these 
training programs think about them? The first survey, therefore, 
was to find out what enlisted men thought about their training, 
particularly the training for their specialty in Navy schools. Called 
Information Survey 1, the title was intended to convey the notion 
that the primary purpose of the survey was to give curriculum and 
Instructor training experts information which would be helpful in 
appraising the strengths and weaknesses of their programs.! 

How can a survey of opinions provide this information? Of what 
value is the opinion of trainees? In looking at the educational 
process, particularly in a military situation, one is tempted to center 
his attention too exclusively on the instructors, the curriculum 
makers, and other experts. Training, however, is not a one-way 
process; it is a two-way process involving both a trainer and a trainee. 
It is the student who is the learner. Learning is conditioned by 
the student's opinions and attitudes with regard to the importance 
and probable usefulness of the material, by his interest in the 
material, and by the many other elements subsumed in the term 
motivation. Moreover, the student is the final applier of the learned 
Material. He is, therefore, in a uniquely favored position to look 
back on his training in the light of the duties he has had to perform. 

The opinion of the consumer, as a criterion of training, is of 
course not equally valid under all conditions. The problem is to 
Set the opinions of those consumers who can look back on their 
training from the most valid vantage point. Trainees who have not 
yet completed their training program may have useful and highly 
Suggestive opinions about the way in which the program is being 
Conducted, but they are not in the best position to appraise its value. 
On the other hand, trainees who have been out on the job for 
Several years may have forgotten а good deal about the training 
Program they went through. Consequently they tend to have only a 
Very general impression of its effectiveness and to have difficulty 
recalling specific strong and weak points. The man who is faced 
during his first few months on the job with the necessity of solving 
Problems which his training has purportedly prepared him to solve 
15 in the ideal position to appraise his training. From this position 
the man’s opinions are most likely to have an intensity and a validity 
of greatest value to the training experts. Information Survey 1, in 
inh assistance of Lt. Comdr. Duane L. Gibson in developing and analyzing this 

Y is acknowledged. 
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other words, may be regarded as a type of follow-up study in which 
the subject-matter is opinions rather than performance. m 
Метнорогосу. In designing Information Survey d. three kie 
problems had to be faced. The first was the problem. of d jpes 
What sort of questions about training should be asked: Two gs 
were agreed upon: (1) general questions about training те dons 
applicable to almost any training program, and (2) specific ques + 
about the curriculum content of each specialty to be answered 0 md 
by men who had been trained for that specialty. The first woe 
cluded such questions as what the men thought about the use n 
of and the time spent on lectures, laboratory work, discuss! by 
demonstrations, training films, slides, etc. Men answered м7 
checking such categories as “too much,” “about right,” “too lit erë 
or “too many,” “about right,” “not enough;” or “all or most A E 
helpful," "about half were helpful," "few or none were help' ob- 
For the second type of question the combined judgment E ie 
tained of the people who wrote the school curriculum anc 5 (0 
people who constructed the final achievement examinations „ои 
what were the major emphases of the training program. These T 
emphases for each of ten specialty ratings were listed on specia 
page supplementary sheets and the men were asked to check the 
much,” “about right,” or “too little” in response to each one in 
light of the duties they had had to perform on the job. tio” 
The second basic problem was concerned with the popula 
What sort of men should answer the questionnaire? Ten SP 


e 
aat А „рад 
training programs were selected—the ones for which special опе nt 


: став 
questionnaires were developed. These ten specialties (elect 


tor 
mate, fire controlman, gunners mate, machinist’s mate, рпа?’ 
machinist’s mate, quartermaster, radarman, radioman, sig? rated 
torpedoman's mate) accounted for Over sixty per cent of a jn 


men aboard ship. It was considered i 


in OF, 
E Р mportant also to obta!P . ing 
ions of recent trainees, 


. ram. 

men who had received their schoo! vbo pad 
not more than a year prior to the study. Only those men we 
actually worked in their specialty would be analyzed. 


The third basic problem, and by far the most difficult. ve 
problem of field work—where to 


the central office in Washington t 
—shakedown centers and redistr 


А т 

Пег ships no very satisfact? 

ork. s? 
uP 


к p А о 
plan was to give the questionnaire to gr 


was found to handle the field w 
The sampling 
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men in those places where a reasonable proportion of cases which 
would fit the sampling objectives could be expected. After the data 
were punched on IBM cards, selected cases would be sorted out for 
analysis. For example, in appraising training in special schools, only 
those men would be used who (1) had attended a naval training 
school for one of the ten specialties immediately following recruit 
training, (2) had graduated from that school, and (3) had worked 
on a job which was in their specialty. The method, in other words, 
was to set general objectives for the survey, and then, because there 
was no effective control over the field situation, to select the sample 
Of cases for analysis after the survey Was administered. Using this 
approach, about sixty per cent of the questionnaires proved to be 
usable. : 

Rzsurrs. The first group of results to be reported centers in the 
area of training methods in Navy schools. Only men who had grad- 
uated from a Navy school and had worked in the field of their 
specialty are included in this analysis. . . 

Training Methods. Replies to an overall appraisal question were 
distributed as follows: 


Question: In the light of what you now know about the duties 
of your specialty (rating) what do you think about the general 


value and usefulness of your school training? 
Percentage of 


Reply graduates 
All or most of it was important and useful 64 
More than half of it was important and useful 18 
Half or less of it was important and useful 18 


Answers to specific questions about training methods were then 
Studied for each of the three groups noted above. Among many sig- 
nificant relationships thus revealed, two stood out more clearly than 
the rest. 


Among men whose Percentage who said that the equip- 
general appraisal of ment studied in school was very differ- 


training was ent from the equipment used on the job 


high ba 
medium 46 
low 


Among men whose 
general appraisal of 
training was 

high 
medium 
low 


Percentage who said that all or most 
instructors were able to put across 
their material successfully 
61 
53 


32 
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The problem of coordinating equipment between the schools = 
the fleet is an administrative one. The problem of providing 500 
instructors for the schools is primarily a selection and training 
problem. | . M s 

The distribution of replies showing the opinions of men W 
regard to their instructors is indicated below. 


Question: How many of your instructors were able to put across 
successfully what they were trying to teach? 


Reply Percentage of graduates 
All or most of them 54 
About half of them 36 
Very few of them 10 


In order to identify what specific practices or elements in the er 
ing program were associated with high appraisal of instructors, ie 
total sample was divided into the three groups indicated above, ae 
the responses of each of these three groups were analyzed. T а 
analysis revealed that the “good teacher,” more than the poor pe 
allowed more time for practice in operating equipment, did " 
spend too much time on lectures, and used demonstrations and E 
cussions more frequently. The good teacher, also, used films, sli s 
demonstrations, and discussions more effectively than the p° 
teacher., n 

The main implications from these analyses are that training Е 
be improved, in the opinion of these men, by providing: 

1. Better instructors 

2. Equipment more nearly like that in the Fleet 

3. More time to operate equipment 

4. More time in the shop and laboratory 
5. More demonstrations 


6. More time for questions and discussion 


E А от 
ut training methods were studied те 


several differences in responses “cre 
men from signalman, radioma®» 


trying to teach. But ~ раб 
1 er, darman programs, less griy 
ssed this opinion of their instructors. Sim cac? 

r c ppraisal of school training was tabulated for of 
specialty, it was n 


; oted that less than 10 per cent of the meP | ар 
gunner's mates, radarman, and radioman programs gave à lo 


machinist’s mates, 
40 per cent expre 
when the overall a 
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praisal, whereas more than 25 per cent of the men from fire control- 
man, machinist’s mates, quartermaster, signalman, and torpedoman's 
programs gave a low appraisal to their training. 

SPECIAL CURRICULA. Two examples of responses to the special 
one-page questionnaires developed for each of the ten ratings are 
reported next. For each rating the range of responses was wide, 
suggesting that the men responded differentially to the various items. 
To illustrate, in the questionnaire for signalmen as few as 12 per 
cent of the men said they had “too little” training in sending and 
receiving semaphore messages; but 41 per cent expressed the opinion 
that they had “too little" training in flaghoist spotting, bending on 
and stowing, and 70 per cent felt they had "too little" training in 
sending messages by flashing light. In the questionnaire for elec- 
trician’s mates, as few as 18 per cent of the men reported “too little" 
training in the use of hand tools and in electrical theory and mathe- 
matics in contrast to 59 per cent who felt they had “too little" 
training in circuit tracing and in blueprint reading and mechanical 
drawing. Results such as these are suggestive of the strong and weak 
points in the training curricula, as judged by the men who have 
had the training and have applied it to their jobs in the fleet. 


Survey of Educational Services 


The second opinion survey, called Information Survey 2, was 
designed to appraise the Navy's educational services program. The 
educational services program (1) provides opportunity for both 
Officers and enlisted men to attend voluntary off-duty classes, take 
Correspondence courses or obtain textbooks from the Armed Forces 
Institute, (2) distributes such materials as newsmaps and war orien- 
tation readings, (3) promotes talks and discussions about the back- 
&round and progress of the war, and (4) carries on similar enter- 
Prises. 

Prior to the war, the Navy's orientation program was relatively 
modest. With the influx of inductees, however, and the growing 
interest in understanding national and world events, the Navy ex- 
Panded its orientation program and added many new features. 

огеоуег, the fact that many young men were taken directly from 
Schools into the Armed Services resulted in the Navy's having a type 
9f population with which it had not previously had to deal in such 
large numbers. In cooperation with the colleges and public schools, 
both the Army and Navy developed methods whereby service per- 
Sonnel could maintain contact with and continue the pursuit of 
their civilian educational interests. As is true of all new enterprises, 
this educational services program was regarded with skepticism by 
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many officials both in and out of uniform. It was felt, therefore, that 
a survey revealing the extent of participation in the program, the 
characteristics of the participants, and the values claimed by the 
participants would be helpful and timely. Accordingly, the Educa- 
tional Services Section requested that a survey be made. 
Метнорогосу. The educational services program is Navy-wide, 
and for this survey random samples of the total Navy population 
were wanted. For these random samples the Educational Services 
Section wanted particularly a good representation of men from over 
seas bases and aboard ships. Questionnaires and instructions for 
their administration were sent to eight overseas bases; and the теп 
were selected by one of two methods, either by calling in all men 
whose service numbers ended in a given combination of figures: OY 
by selecting every nth name from a roster of the ship's company: 
The bases included large ones and small ones, old ones and new 
ones, and were spread geographically from the Aleutians tO the 
South Pacific. The shipboard sample was obtained by administering 
the questionnaire to large unselected groups of men returning fro 
sea duty. These men were tested durine their first day at receiving 
stations (most on the West coast and a few on the East coast) an" 
were instructed to answer the questions in terms of conditions 
aboard the ship on which they had just served. An additional samp | 
was obtained from the ship's company of one of the large training 
centers in the United States. Ninety per cent of all the questio?" 
naires sent out were returned. 
: > . e 
У ince i2 reflected the major aspects pre 
(1) questions on ечеи included three types oF qe ices 
activities, (2) оа the various educational 86 фор 
se Pinions of or value of these V? -y 
activities, and (3) groups of questions to measure respectively А 
formation about the war, attitudes about the war ud the futur 
and post-war educational plans. The infor ки uestions wer 
scored on the basis of the number of qu верни а correctly 
The score on the attitude questio. M a pus e 


: ns was the number answere es 
tively. For the estimate h 
of post-war educati proa. 

5 ional plans two app! |» jn 

were used. One was simply th plans al i 


e number id “ scho?" , y 
answer to a free-res who said “go to they 


ponse question about of work "in 
planned to do after the у the sort і 
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Resutts. The results were presented in a series of nine reports 
under the general heading Navy Men Appraise Educational Services. 
These results are summarized here under the two general headings 
of orientation and education. 

Orientation. The first series of results is described under the 
general heading of orientation. Most Navy men said that they got 
the news every day; 61 per cent reported daily reading of a paper 
and 71 per cent reported daily listening to radio news broadcasts. 
Eighty per cent of the men said that the Navy's weekly newsmaps 
were available at their location. Interest was also high in having 
talks and discussions on the background and progress of the war; 
60 per cent indicated that they would like to hear regular talks 
at least once a week. The questionnaire also included a list of twelve 
topics related to the war, its background, and the nations involved, 
ànd asked the men to check each topic they would like to read about 
during off-duty time. Every topic was checked by more than half 
the men, and two-thirds of the men expressed interest in reading 
about seven or more of the twelve pamphlet topics listed. 

The relationships between these expressions of interest (in news, 
S and readings) and certain expressions of attitude are shown 
elow, 


Percentage of Men Who 
Get News Daily Are Interested 


Among Men for Whom a Clear Want Talks and. ———————— in 11 or 12 
Understanding of Why We Discussions at Least By By Orientation 
Are Fighting I$ Once а Week Paper Radio Readings 
à. Absolutely necessary 45 64 78 = 
b. Of great importance 41 of 72 is 
€. Of medium, little or 
no importance 25 SE ба 19 


Percentage of Men Who 
Get News Daily Are Interested 


Among Men Whose Attitudes Want Talksand ———————. in I] or 12 
about the War and the Discussions at Least By By Orientation 
Future Reflect Once a Week Paper Radio Readings 
à. High motivation 46 67 76 44 
b. Medium motivation 40 59 71 33 
€. Low motivation 34 56 64 25 


The figures indicate that men who say it is absolutely necessary to 
them personally to have a clear understanding of why we are fighting 
Show the highest level of interest in talks and discussion, news get- 
"ng, and orientation reading. 

he same pattern of relationship is indicated between these ex- 


Pressions of interest and attitudes about the war and the future. 
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i e of 
Four questions in the survey were grouped to obtain a measur 
these attitudes. 


“In your opinion is the United States fighting for things that 
you feel are worth fighting for?” (check one) 


1__ Yes 

2__ I think so, but I’m not sure 
3. No 

4__ Undecided 


“Do you ever get the feeling that this war is not worth fighting?” 
(check one) 

1__ Very often 

2__ Sometimes 

3__ Only once in a great while 

4__ Never 


“After the war is over, do you think the United States will be 2 
better place or a worse place to live in than it was before the 
war?” (check one) 

1.— Worse after the war than before the war 

2__ Same after the war as before the war 

3. 


— Better after the war than before the war 
4__ Undecided 


“How important do you think it will be for the United States, 


Russia, England, and China to cooperate closely with each other 
after the war?” (check one) 
1__ Absolutely necessary 
2__ Pretty important 

3__ Not so important 
4__ Don’t know 


These four questions were “scored” 
to the number of questions which they 
who doubted that the U. 8. was fighti 
sometimes or often felt that the war 
thought the U. S. would be worse aft 
the necessity of close cooperation am 
war were regarded as having “negat 
positive convictions on all four 
“high motivation”; 
the four questions 
and men whose at 
of the questions w 


and the men grouped accord; 
answered “positively.” Th ho 
ng for worthwhile goals, b 
Was not worth fighting i ed 
ег the war, and who dou the 
ong the major allies after E 
ive" attitudes. Men who vini 
questions were regarded as hav" © 
men who held positive convictions on тег "n 
Were regarded as having “medium motiva 
titudes were positive on only two, one, or ? 
ere regarded as having “low motivation." 


15 
1 ri 1 З В ings 
Interest in orientation—news, talks, discussions, and reading? 


Р ob 
high. Opportunity to satisfy this interest should be equally a 


The survey indicated several major areas where opportunities sho 
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be widened. Among men afloat, for example, the proportion who 
got the news daily and who saw the newsmaps weekly was signifi- 
cantly smaller than the proportion among men ashore. Also, the 
interests of only a few men in talks and discussions were being 
satisfied: among men who would like to hear talks at least once a 
week, only 28 per cent actually heard talks that frequently, and 54 
per cent of these men said they never heard any talks. 

With respect to orientation, in summary, the survey demonstrated 
that the interests of men were high, that these interests were related 
to positive convictions about the war and the future, but that oppor- 
tunities to satisfy these interests were limited. 

Education. The second major area of the survey is considered 
under the general heading of educational opportunities. The results 
indicated that 30 per cent of all naval personnel were using educa- 
tonal opportunities offered by Educational Services—either attend- 
Ing voluntary off-duty classes or taking work under the United States 
Armed Forces Institute (USAFI) program. 

One man in five said he had attended off-duty classes at his present 
location. Those who participated belonged to no special group as 
to age, length of service, or rank. They were a fair cross section 
of the Navy as a whole. A significantly higher per cent of high school 
graduates did, however, attend the classes—60 per cent of those who 
attended were high school graduates in contrast to 51 per cent gradu- 
ates in the total sample studied. Opportunities offered in the way of 
voluntary classes and attendance varied from place to place: at ad- 
vance bases 72 per cent of the men said off-duty classes were offered, 
and 19 per cent of the men attended. At the training center 82 per cent 
Said there were off-duty classes; 21 per cent attended. Among men 
afloat, chances for attending classes were most limited; only 22 per 
Cent said there were classes, but 10 per cent attended them. — 

In rating the off-duty classes, 42 per cent of the men said they 
Were very valuable. Only 5 per cent considered them a waste of time. 
And, significantly, the way men rated their classes corresponded with 


the way they rated the teachers of those classes. 


INSTRUCTORS RATED 
Pretty Good Poor 


Classes Rated Very Good 
Very Valuable 7497, 219, [59] 
Of Some Value [ 38% 55% [7% | 
Waste of Time | 15%, 40% | 45% | 
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One man in five participated in the work of the United we 
Armed Forces Institute which offers correspondence courses, cae 
teaching courses, and textooks for self-study. The survey age 
that 10 per cent of the men had signed up for a correspondence а 
self-teaching course from USAFI, 5 per cent had gotten textboo! : 
and 3 per cent had done both. Of the men who took bcp pon: 
USAFI, 47 per cent rated their study as very valuable, only 2 pet 
cent as a waste of time. | É 

Postwar jobs and personal interest were the chief motives fos 
study. Those who participated in the USAFI program or who at- 
tended off-duty classes gave these reasons: 


Percentage of Men Giving 
Reasons for Participation in 
Off-Duty 
Reasons USAFI Work Classes 
Subject was related to work I hope to do 
when the war is over 


28 16 
Wanted to learn something which inter- у 
ested me personally 18 26 
Subject was related to my Navy Job 12 25 
To get high-school or college credit 25 10 
All others 17 23 

С : ~ „ог 

The desire to learn more about their Navy jobs and the hope 9 


getting high-school or college credits were almos 
motives for study. 


Of the 5 or 6 


Б ant 
t equally import? 
:adicated 
survey who en 
-time school after the war, one in f! 


: п (0 
ot say that they intended to return 


E ut 
In the procedure the Navy has worked e 
for accreditation. Of all the men surveyed, 95 per cent had ask 
advice about school credits and courses, 


= 5 

8 Opportunities for voluntary pi 

s "*l 4 OF ive. 

l proportion (30 per cent) while 

men of all sorts were maki by 

appeal for men whose formal education гес“ 

the war. The orientation services were found to be operating € the 

tively with respect to keeping men up-to-date on the news 9 tan 

war. Opportunities to discuss and clarify some of the impo е, 
background and causal events and ideas related to the war “ 


Information Surveys 421 


however, more limited. Most men felt that it was highly important 
to them personally to have a clear idea of why they were fighting. 
Partly as a result of the survey, the Navy expanded its Educational 
Services program, laying greater emphasis on the formation of dis- 
Cussion groups and increased opportunities for study during the 
post-hostilities period. 


Attitude of Amphibious Forces Personnel 


The third major survey was concerned with the attitudes and 
Opinions about the amphibious forces which were held by enlisted 
men in that type of duty. The purpose of the study was to determine 
the opinions which men have about amphibious duty and to identify 
factors which were related to favorable opinion so that positive steps 
might be taken for improvement of attitudes and opinions. Amphib- 
lous warfare was largely a development of World War II. Because 
ОЁ its urgent need for large numbers of personnel and because of 
the necessarily rapid expansion which it underwent, the amphibious 
forces, were assigned an especially heterogeneous assortment of per- 
sonnel, Requiring a mass base, amphibious duty, unlike naval avia- 
Чоп or the submarine service, was not generally regarded as an elite 
or prestige-bearing type of duty; yet its importance in winning the 
War was indisputable. Also, because of its newness and its size, train- 
ing methods were less well established than for older and more 
exclusive types of duty. This combination of circumstances made it 
desirable to conduct an analysis of attitudes and morale among 
amphibious forces personnel.? 

Метпорогосу. The survey was initiated at the request of the 
Amphibious Training Command, Pacific Fleet. A questionnaire was 
administered during the months of April and May 1945 to a class 
9f about 800 men who had just completed primary training for smal] 
attack boats and to 400 men who had just completed advanced train- 
ng for these small boats. In addition, in order to provide a sample of 
Men with amphibious experience for comparison with those recently 
trained, the questionnaire was administered to 400 men in ship’s 
Company and attack boat crews of four attack transports.? 

, The questionnaire was developed after extensive analysis of 
“milar studies conducted by the Research Branch, Information and 
ducation Division, of the Army General Staff and in consultation 

With personnel at the Amphibious Training Command. 
* The development and analysis of this study was guided by Mr. George Hausknecht 


wit h а 
i the assistance of Lt. Comdr. Duane L. Gibson. | 
пој 180101 comprising the attack boat crews оп board attack transports (АРАЗ) are 
War Considered to be members of the regular ship's company manning the attack 
ansport, 
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In order to avoid giving the impression to the men ae 
that the amphibious forces were being singled out for — 7 
the questionnaire was drawn up = vn А не as to ma 

i to persons in any type o avy duty. 

eh nod a the ene К аа about the background st 
extent of naval experience of the men in the sample, the — 
naire included items to obtain information about each of the "e 
lowing areas of opinion: (1) fundamental motivation, (2) = 
preference for type of duty and Opinion of the prestige of di ous 
types of duty, (3) satisfaction with job assignment, (4) attit кы 
inion of shore training, (6) personal адји 


of Navy life was analyzed 1 
which might be helpful. 

RESULTS. The fi 
graphed 


sample into motivation types. 
“In your opinion is the Un 


feel are worth fighting for?" 
1__ Yes 

2__ I think so, but I'm not sure 
3. No 

4 . Undecided 


"If it were up to you, what kind of an outfit would you rather 
be in?” 


ited States fighting for things you 


l.. Ina combat outfit overseas 
2 


3 


I__ Serving in the Na 
2__ As a war worker 
3— Undecided 
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ceptance of hardships and risks in support of their principles, (2) 
acceptance of the principles but avoidance of the consequences, and 
(3) disbelief in the principles. The six motivation types and their 
distribution among the sample of amphibious forces men were as 
follows: 

Percentage of Men 


Group Responses to Three Questions in Each Group 

A Feel the war is worth fighting; choose combat; 

choose military service 22 
Bt Еее] the war is worth fighting; would avoid 

service; but do choose combat 14 
с Feel the war is worth fighting; choose service; 

but would avoid combat 16 
D Feel the war is worth fighting; but would avoid 

military service and combat 35 
Е Doubt the worth of the war; would avoid mili- 

tary service and combat 10 
F Do not think the principles are worth fighting 

for; would avoid military service and combat 8 


Despite the rather large proportion who would prefer not to be in 
combat duty (about two-thirds), the response of the men to questions 
9n their confidence in their ability to perform adequately in combat 
Was highly favorable. Fewer than 10 per cent of the men felt that 
they would never be able to do well in combat. 

Even among the best motivated men, the proportion of those who 
Would avoid amphibious duty if they could was seriously high, with 
Nearly half saying that they would try hardest to stay out of the 
amphibious forces over all other types of Navy duty. Among the 
ae poorly motivated group, 69 per cent would avoid amphibious 

uty, 
. Motivation showed a marked relation to personal adjustment to 
life in the Navy and to convictions about the outcome of the war, 
Oth as to its effect upon life in the United States after the war and 
the likelihood of achieving the goals for which the war was fought. 

Prestige of Amphibious Duty. Amphibious duty was found to 

be held in higher esteem by men aboard amphibious vessels than 
Y men at training centers. A significantly larger proportion would 
сеју choose it as a preferred duty and far fewer would avoid it 
among the men aboard ship as compared with the men at training 
Centers, In expressing their preference for a type of duty, men in 
the shipboard sample placed amphibious duty first, aviation second, 
AM destroyers third; but among men at training centers, aviation 
4 This Broup, which appears inconsistent, is 


avoid mili і г 5 
itary service, but since they аге now 1 
combat duty,” е, у 


interpreted as men who would prefer to 
п the Navy they accept the idea of 
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was the most frequent choice, destroyers second, armed guard third, 
with amphibious duty in ninth place. - ай 
The low prestige which is accorded to amphibious duty by 1 es 
at the training centers may well be partially accounted for by la н 
of information or negative information which is, to some esia 
dispelled after assignment to actual duty aboard ship. A majority "s 
the men claimed to have heard nothing about the amphibious e e 
before assignment; but among those who had heard anything, 11 
great majority had heard unfavorable rumors. sed 
In reply to a question as to whether respondents had SE á 
their attitudes toward amphibious duty, about two-thirds of a 
men afloat and at training centers indicated that they had change à 
their views. Ninety-two per cent of men afloat changed in the punti 
tion of greater respect for such duty, as compared with 61 per сер 
for those in training centers, 
Men were asked to indicate 
preference. They were also as 
avoid and to explain their 


a preferred duty and to explain y 
Кеа which duty they most wantec rt 
reasons. These reasons were in supp 
of choosing or avoiding various duties, not necessarily ape 
duty. They form a generalized set of factors in the prestige of а 
duty. " 
Only two positive factors (i.e. elements of prestige causing me 
choose a particular duty in preference to all other duties) меге 1" mé 
tioned by as many as 10 per cent of the sample. These were : 


. . . usc 
portance in winning the war" by 33 per cent, and “chance t? ige 
n PEA ? i [eoe 
skills and training” by 10 per cent. Four negative factors in ene 
were offered by 10 per cent or more of the sample. These pos j 
"high casualty rate,” 18 per cent; “no advancement," 16 per € 

excessive hardships,” | 


- ige” 12 Ре 
13 per cent; “low service prestige, ^7 
cent. 


ors 1 


positive and negative fact ha? 
prestige as they relate to ibi 


us duty showed that mor l 
was most important and 2? 


у 8 a feeling of pride in the x in 
‘importance in winning the war" appe e 2 
ndirect way of saying that in their opi felt 
esteem, and half of the men in the samp ces, 
ot know enough about the amphibious си D 
| Negative prestige factors, 4 in 10 of the eX in 
the sample felt that amphibious duty was the most dangerou. | 0 
more hardships than any other duty, and 5! er 
that the rest of the Navy looked down on amphibious force? 
sonnel. j 
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The responses to many of these items pointed to the need for an 

active indoctrination program which would provide correct informa- 
tion about the factors which men consider important in the prestige 
of their duty. About half of the men expressed an interest in addi- 
tional orientation in the amphibious forces, including one-fourth of 
the total stating that they had never had any. 
| Attitude Toward Officers. By combining responses to two ques- 
tions, the men in the sample were separated into officer appraisal 
types. These were based on the men’s opinion of the proportion of 
officers who are personally interested in them and their opinion of 
the willingness of those in charge to help. About half of the men in 
the sample felt that they could get help most of the time from at 
least a few officers who took a personal interest in them. 

Men’s experience in the Navy appeared to influence greatly their 
Opinion of officers. Men in a training situation were found to have 
а much lower opinion of officers than men aboard ship. Unfavorable 
Opinion of officers was also found more frequently among men who 
had been in service for some time than among those with shorter 
Naval experience. Men sent into training for amphibious duty after 
a year or more of Navy service were extremely unfavorable in their 


attitude toward officers. 


Percentage of Men 
Officer Giving Each Response at 
Appraisal Training 

Type Response Center Ship 

5 All or most take a personal interest and 
help all or most of the time 22 36 

1 Half take a personal interest and help all 
or most of the time 9 14 

3 Few take a personal interest and. help all 
5 or most of the time 13 19 

s Half take a personal interest but they often 
don’t help 5 14 

| Few take а personal interest and they often 
don’t help 25 15 

9 Few or none take a personal interest and 
26 14 


they almost never help 


Attitude toward officers was not related to such personal charac- 
teristics of the respondents as age education, marital status, pay 
Stade or specialty. On the other hand, several aspects of naval ex- 
perience in addition to those of training and length of service were 
Telated to opinion of officers. Men who felt that their officers had a 
Personal interest in them and were willing to help them were more 
likely to have a favorable opinion of amphibious forces duty and 
to be satisfied with the jobs which they were doing within that duty. 
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These men with a favorable opinion of their officers were also pecie 
likely to be well motivated e the war and less likely to ha 
ms of maladjustment to Navy service. . 
PIE дина be — out that би ате doubtless many оре 
in which the claim that officers are not personally interested in "s E 
men is unjustifiable. If, however, the men feel that there is a ar idi 
interest, it is real to them and thereby becomes a problem wh 
must be dealt with. €— 
Job Satisfaction. Job satisfaction was measured by a score obta 

from the combined responses to two questions: 


"How satisfied are you about bein 
instead of some other?" (check one) 


1__ Very satisfied 
2__ Satisfied 
3 


— It doesn’t make any difference to me 


& in your present Navy job 


4__ Dissatisfied 
5— Very dissatisfied 


“Would you change to some other N 


avy job within your type 
of duty if you were given the chance?” (check one) 
1__ Yes 


2__ No 
3__ Undecided 


Percentage of M 
in Each Category 


s ainin ; 
Job Satisfaction Category pe Ship 


30 
i 6 
8 зацы but undecided about changin 3 8 
2 ontradictory responses or co, 1 - 

ecided Ија 14 23 
1 Dissatisfied but undecided about chang; 3 A 
0 issatisfied and would change "OMNE 74 * 


were 
education апа marital seen 
ton. There was some relatio rd 
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adjustment to Navy life and with a negative attitude toward am- 
phibious duty. The index of adjustment to Navy life was obtained 
from the pattern of replies to three questions included in the survey. 
Only 3 per cent of the men who were satisfied showed a low per- 
sonal adjustment score, compared with 22 per cent of the dissatisfied. 
Among men who would choose amphibious duty, 7 per cent were 
dissatisfied with their jobs, as compared with 81 per cent dissatisfied 
among those who would like to have rejected it. 

_ Certain attitudes relating to the job also appear to be important 
m contributing to job satisfaction. The following table identifies 


these attitudes 
Percentage of Men 


Who Were 
Attitudes Satisfied Dissatisfied 
Were very much interested in their jobs 75 
Believed they had a good chance to show their 
abilities 72 15 
Believed everything possible had been done to 
place them in the best possible job 56 4 
Had civilian skills which they believed were 
being used at least half the time 48 13 
Thought they had a good chance for promotion 37 12 


Apparently job satisfaction can be improved by taking positive 
Steps to improve these elements of job satisfaction. Greater effort 
directed toward a program of orientation both to Navy life and to 
amphibious duty would also contribute to a better attitude toward 

€ job. 

Opinion of Shore Training. The enlisted men's evaluation of 
their shore training was based on the following questions, asked 
Separately for those with sea duty and for those who had not yet 

сеп. to sea: 


(For those who had had sea duty) | : 

"Do you feel that your training ashore made it possible for 
You to handle most things that came up?" 

(For those who had not had sea duty) . 

"Do you think your training will make it possible for you to 
handle most things that come up?" 


Percentage 
Reply of Men 

l. "Yes, my shore training gave (will give) me the 'know 

how’ for almost everything" 14 
2. "Yes, but I had (will have) to pick up a few things on 

my own” 46 
8. "I was (will be) about half trained" 8 
4 "No, I had (will have) to learn a great deal оп my own" — 24 


- "No, the training didn’t (doesn’t) amount to anything" 8 
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For purposes of analysis, men who checked the first or second 
replies were considered as having expressed the opinion that their 
training was "adequate." Those who checked one of the last pne 
responses (i.e. "half trained" or less) were considered as indicating 
the feeling that their training was "inadequate." 

The more recent the training, the higher the opinion of its ade- 
quacy. About two-thirds of the men who had been in the Navy less 
than one year felt that their training was adequate, compared with 
little more than one-fourth for those who h I 
than three years. Likewise, men who had up to six months of sea 
duty considered their training more adequate than men who had 
over two years of sea duty. The most likely explanation of this lies 
in the fact that men who had already served over two years at sca 
had received their shore training during a very early stage of the 


war when, admittedly, systematic training for amphibious duty was 
just being developed. 


ad been in for more 


Appraisal of training was found to be so interrelated with other 
aspects of adjustment to Navy life as to appear to require a simul- 
taneous attack on several fronts in order to effect major improve 
ments. Men who felt that their shore training had been adequate 
were significantly more likely to be well motivated, well adjusted to 
Navy life, to feel favorably toward their officers, to have increase 


respect for the amphibious forces, and to be high in other indica 
tions of good adjustment to Navy life. у 

Half the men who con 
stated that their instructors 
the teaching across. This co 


н “ned 
sidered themselves adequately train? 
had plenty of experience and could 8* 


с mpares with 27 per cent for those who 
felt themselves inadequately trained. Among those who felt they 


were adequately trained, more than half felt that all of their training 
Was necessary, as compared with 37 per cent for those who felt 
that they had not been well trained. Men who considered then 
training adequate were more likely to have been provided wit! 
orientation in the history and importance of the amphibious forces 
than were those who felt that they had been inadequately trained- 
Summarizing the amphibious forces Study as a whole, it тау. | 
said that several attitude areas Were identified and studied wi” 


. H . H 5 
respect to their association with each other and with numero" 
specific factors of experience, backg: 


suggested, in several instances, specific personnel practices or pos. 
cies which should be instituted i 

most of the attitudes studied were 
cepts of morale, personality, 
elements. The improvement 


5 E 
dins b ipai of any one Specific element, suc fec 
providing better indoctrination in amphibious duty or more € 
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-— instructors in amphibious training, may be expected to make 
"a y a limited contribution to the overall problem. The analyses 
осир PURA Main 

iggest that specific practices should be looked upon as related to 
arge problems. 


Some Factors Influencing the Value and Usefulness of 
Opinion Research 


arch, as illustrated by the three surveys 


The value of opinion rese 
factors—some technical, some ad- 


Just described, depends on many 
ministrativ : у А à 5 
inistrative, some judgmental. It would be possible to discuss in 


detail = Еи 5 3 x 
etail a series of technical problems, such as sampling, question 


vording, cross-tabulations, statistical significance of sampling devia- 
hich relates to the reliability 


tions or percentage differences, etc. W 
ang validity of opinion data. Then, such administrative problems 
as the interest of management in the results, the appropriateness of 
аре method to the topic, the use and interpretation of re- 
“Siena be considered. Rather than discuss a series of specifics, 
'er, we shall consider the more important problems under two 
broad headings—the problem of suitability, and the problem of 
interpretation. These categories are arbitrary, but they will serve 
Stress what the writer regards a5 the two most fundamental con- 
Siderations in opinion research, particularly in the Navy. 

THe PROBLEM OF SUITABILITY. The suitability of a topic for ad- 
aur NM action is a problem which should be considered in 
sing whether ox not emt emp, depending 
on ther acmon should be pans a Е ^ i „ пер "n i 
of th results of the survey. For example, a survey OF W hat men thin 
ааа Navy school training in the light of нае subsequi jn 
aes s of that training, can identify areas OF g р‹ s 

pects of training which the experts should re-examine. This re- 
*Xamination can then lead to changes in the training program. The 
Stimulus for Information Survey 9 was a contemplated administra- 
i action by the Educational Services Section. Authorization to 
icy its services was about to be granted in anticipation of the 
pete i an enlarged program in the post-hostilities period. An ap- 
for ra of the present program was regarded as offering guide-lines 

he proposed expansion. In the amphibious forces study, the 


exis s 
fh aed of a morale problem was recognized by certain officers at 
is. Amphibious Training Command. The survey was made to 

entify this problem more specifically and to analyze it in such a 


wa " utr: : 
ey that improvements in personnel and training practices could 
Suggested, 
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The extent to which the topic of a survey is suitable for nea 
trative action is influenced by two questions: (1) does some а те 
istrative agency desire the survey, and (2) does the survey ач 
an analysis of attitudes in relation to personal characteristics Е 
attributes so that a basis for change іп personnel or training p Es 
tice can be suggested? The maximum value to administration = 
a survey will be obtained when both these questions can be answe 

itively. : 

ud consideration is the suitability of a topic or реч 
to the research methods of opinion surveys. There are a good и. 
questions to which opinion or information surveys can not Spon 
the most useful answers. For example, to ask a cross section of ~ 
about their food preferences is not as objective a method of anaye 
such preferences as the method of measuring quantitatively dy 
amount of left-overs. Other topics may be considered as proper 
reserved for expert judgment: for example, should the Navy Ba 
more or fewer aircraft carriers? should an advance base be a al 
at X location? should mastery of a foreign language be require 

Naval Academy graduates? or 

A third consideration closely related to the second is wh 
not the topic is within the experience of the men to be polled. be 
the men have some basis for an opinion? The topic itself a es 
unsuitable or the kind of questions asked may be waso i6 
Whether Naval Academy men should or should not be require 


study a foreign language is a decision for experts. But it woul 
appropriate to poll Academ 


and for what purposes the 
foreign language they stu 
of the questions about t 
rience of the graduates: 
do you think about vari 


ious forces study men were asked ab 


tly 
d the 


» it is desirable to ask rather general quet, 
for the purpose of revealing prejudices, misconceptions, or St® ге 
typed opinions. But as a guiding principle, questions whic Jicit 
perience of men in the sample will € 

of opinions. ually 
RPRETATION. Single questions are pet 
ations of complex attitudes. Interpret ach 
of results is often aided, therefore, when several questions are © ay 
related to a single general attitude. Such a group of questions ег? 
be called а scale. It can be determined experimentally whe ж by 
group of questions actually hangs together; or it can be decid? 


the most useful catalogue 
THE PROBLEM or INTE 
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experts which questions should be studied in relation to one another. 
If there is such a pattern, the responses to the combination of items 
can be scored or “scaled.” In the amphibious forces study, the 
responses to two or more questions were combined to obtain opinion - 
Scores in the following areas: motivation, personal adjustment, ap- 
praisal of officers, and job satisfaction. In Information Survey 2, 
items were combined to obtain scores on the subjects of attitude 
toward the war and future, knowledge of war events, knowledge of 
home-front events, knowledge of background facts, post-war educa- 
поп plans, interest in talks and discussions, and interest in War 
orientation readings. 

When a single general question is asked to obtain a summary 
Opinion about some rather broad topic, the interpretation of re- 
sponses to it is meaningful when it can be studied in relation to the 
Specific elements it subsumes. For example, Information Survey 1 
included a question to elicit an overall appraisal of school training. 
The replies were then studied in relation to specific aspects of train- 
Ing to determine which were most highly related to the overall 
appraisal. Similarly, appraisal of instructors was studied in relation 
to a series of specific teaching practices to determine which practices 


Were most highly associated with high and low regard for teachers. 
Another type of relationship which should be considered in inter- 
Preting the results of opinion surveys is the relationship among 
Several areas of opinion. The Amphibious Forces Study showed 


Clearly that opinion of officers, job satisfaction, opinion of the pres- 
ion for war service and combat, 


tige of amphibious duty, motivat à 
nd personal adjustment to Navy 


Opini Rs ie 

| mae of amphibious training, а тѕопа! а. d 

iife were all related to one another. The implication of such findings 
practice in any one of the 


15 a a . : : 
i that administrative changes in policy or 
reas should be made after estimating the probable effect on related 
areas. The desirability of a coordinated attack is implied. : 
A final and highly important problem in interpreting attitude 
dministrative 
de study is to reveal problems 


Studies is the problem of what the data imply for a 
aisal by experts. Another 


acti Caer : 
= One contribution of an attitu 
Е topics which аге in need of critical reappr EU 
9ntribution is to estimate the effects of personnel and training 
Policies, Do attitudes change following changes in personnel or 
ier practices? The most profitable way to clarify the implica- 
he of opinions for administrative action is to analyze them in rela- 
n to th i . = them and in relation to other 
associ e attributes of men holding I eS 
it lated factors. With respect to orientation for amphibious duty, 
d much about the amphibious 


» that most men had not hear 
t, that among those who had 
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heard something, most had heard unfavorable rumors, and por By 
substantial number of men expressed an interest in depo Дарн 
reading articles, or seeing movies about the development, sho аз 
importance of the amphibious forces. The need for а more i^ ~ 
sive and effective indoctrination program along definite lines ме 
clearly indicated. On the other hand, the fact that men said, as th У 
did in Information Survey 1, that "too little" time was spent o : 
practice in operating equipment during their Navy school Sion ie: 
does not automatically mean that more time should be alloted | : 
this activity. It does suggest, however, that experts should reapp? me 
the distribution of time in training schools in the light of ue 
opinions expressed by men who have been faced with the necessity 


of applying in the Fleet the knowledge and skill which their training 
purportedly gave them. 


When adequate attention is 
suitability and interpretation 
cal research problems, opinior 
ful evaluative data for person 


given to these basic problems of 
; in addition, of course, to the technt- 
1 studies can provide valuable and use 
nel and training programs. 


CHAPTER XXII 
PROBLEMS FOR FURTHER STUDY 


IN the preceding chapters there has been reported some of the 
research on Navy personnel problems conducted by the Test and 
Research Section, NDRC Project N-106, and the College Entrance 
Examination Board. Aptitude and achievement tests prepared or 
Officially approved by the Test and Research Section have been 
described, and their use and effectiveness indicated. A perusal of 
these chapters reveals that although psychological and educational 
tests were developed and research studies were carried on for a large 
number of officer and enlisted programs, only a beginning had been 
made in studying problems and developing procedures for use in 
certain areas. In other aspects of Navy personnel programs, the 
heeded studies, though contemplated, had not even been started. 
The exigencies of the war necessitated work first of all on the 
Most pressing problems—those involving large numbers of persons 
9r particularly difficult or technical training programs or duty assign- 
ments, and those which promised the most immediately useful re- 
Sults. As a consequence, the time spent in validation of tests was all 
too short, the research studies in the field of selection and classifica- 
üon were fragmentary, and studies on training were barely initiated. 
By August 1945, however, data Were accumulating on the basis 
ОЁ which some evaluation could be made of existing classification 
and training instruments and procedures, and proposals could be 
made for trying out other techniques, for developing other possibly 
More effective instruments, and for examining some scarcely touched 
ЧЕ extremely critical problems. This chapter will outline some, of 
the modifications in classification and training procedures which 
ave been indicated by the experience of the Test and Research 
*ction, it will suggest some of the lines of investigation which may 


be found fruitful, and it will comment briefly upon problems of a 
methodological nature. No attempt will be made to present an 
for the post-war personnel 


ex i : à 
Y haustive or comprehensive program °l. on 
esearch program, since that is the province of the technicians 
H d H 1 ~ Z 
responsible for administering and implementing such a program. 
here are included only some selected proposals which have grown 
Out of the experience of the past four years and which the writers 
Eleve would be immediately useful to the Navy. 0. 
asic of course to any program of selection, classification, and 
'aini ә . : 
training is sufficient accurate information about what men do in 


Navy jobs. The job analyses necessary to obtain this information will 
433 
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need to consider in detail the specific duties, responsibilities, a 
capabilities involved in each type of job, the degree of prennan 
and physical fitness required to perform the various activities, a : 
the extent to which there is overlapping among billets in terms 9 
duties performed ог skill and knowledge demanded. Following vt 
job analyses of specific billets, the billets need to be classified, usi g 
as small a number of job families or types as is consistent with actua 
differences in the operation or personnel requirements of the binen 
For effective classification and training, these requirements shou 
be expressed in terms of such factors as aptitudes, skills, interests, 
education, experience, and physical and personal characteristics 
Techniques for weighting and evaluating the factors for differen 
types of billets must be developed and validated. 


Research on Techniques of Selection and Classification 


The goal of a research program in selection and classification 
should be to provide information and techniques which will ma h 
possible the most effective use of the manpower available. Suc 
effective use of manpower implies not only that every officer um 
enlisted man is placed in the job where he can make his great a 
contribution, but also that the optimum placement of each у 


: К А t > s jent 
1s accomplished in the minimum amount of time, Given suffic! 
time, even with inade 


ably "shake down" o 
fied. In the early st 
of the Navy is in 


zi g 
creasing rapidly, the saving of time in makiy 
nsiderably the manpower auld 
etime research program a dily 
€ procedures which can f men. 
tion of large numbers of jeld 
umber of proposals in Фе osals 
escribed. Some of these proP ink 
procedures which might Ре гор" 
d evaluation. Others outline Р ive 


n. 


R 
yo 
WHAT ARE THE MINIMUM AND OPrIMUM REQUIREMENTS of 
ASSIGNMENTS TO EACH TYPE or Мплтаку Dury? The pro gn 
determining the minimum and 
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terion of success is essential for any study of this type. (See Chapter 
XIX and later discussion in this chapter). In addition to the usual 
type of statistical study, it would probably be fruitful to make clini- 
cal studies of the individual cases where prediction failed. Such a 
technique might bring to light important hidden factors influencing 
success in a particular job. It might reveal job characteristics which 
were incompletely described in the preliminary job analyses and 
which are found to be crucial in determining failure or success. 
These findings would perhaps indicate what line of investigation 
should be followed in developing selection devices for the improve- 
ment of classification procedures. 

COULD SELECTION AND CLASSIFICATION BE IMPROVED THROUGH THE 
Оѕе or Two ок More BATTERIES OF TESTS IN. MULTIPLE-STAGE 
SELECTION? The use of one set of tests for two such diverse purposes 
as separating school from non-school material and separating candi- 
dates for one type of school from candidates for another type of 
School is likely to result in tests which are not entirely suitable for 
either purpose. Furthermore, the administration of an extensive 
battery of tests to an unselected group of persons is probably very 
Wasteful of testing and test scoring time. It might be possible to 
administer a greater variety of tests without increasing the total 


Ume spent in test administration by the device of using a short 
p типату battery, to sort men into rough categories, and additional 
e of making more specific 


Se А 

Condary test batteries for the purpos 
assignments, | 
In the first selection stage, the primary battery for enlisted men 


Might consist of only two tests, a verbal test and a mechanical test, 
their intercorrelation as much 


с 5 
Onstructed in such a way as to reduce 
could be used (1) to separate 


as В 
sei Possible. Scores on these two tests ) à 
1001 candidates from the non-school material, and (2) to classify 


the school candidates as to general type of school for which they 
should be considered. The scheme might work somewhat as follows: 
(а) men low on both verbal and mechanical tests would be assigned 
to general detail: (b) men who are high on verbal but low on 
Mechanical tests would be considered as candidates for “clerical” 
types of schools (yeoman, signal, radio); (c) men who are high on 
Mechanical but low on verbal tests would be considered as candi- 

ates for “mechanical” types of schools (gunner's mate, basic engi- 
neering, metalsmith) and (d) men who are high on both tests would 

€ considered as candidates for the more highly technical schools 

те controlman, radio materiel). . 
(9 he second stage would be to administer to the men in groups (b). 
m. nct (d) secondary batteries of tests designed especially to aid in 

aking assignments to schools within each group. For example, the 


436 Problems for Further Study 


men in the "clerical" group might be given tests measuring aptitude 
or ability in spelling, clerical work, radio code, and blinker sig- 
naling which wouid aid in distributing men to the schools in that 
group. адз 

In such a program each man would be given only “appropriate 
tests and the time required for testing and scoring would probably 
be less than that required in the present procedure of giving every 
basic battery test to every man. Tests designed for specific purposes 
might also be more valid than the general-purpose test and permit 
a greater use of individual abilities. A research program to investi 
gate the feasibility of such a plan in classifying both officers and en- 
listed men might yield important results. 

WHAT Is тне SMALLEST NUMBER or Tests Tuar Can Br USED 
EFFECTIVELY IN A Basic Trsr BATTERY? The answer to the question 
of how many tests should be included in a basic test battery might 
depend to some extent on the administrative procedures that are 
adopted for use in making assignments. (It would of course be 
sounder to base the administrative procedures upon the results © 
experimental study of single-stage versus multiple-stage testing)- 1 
the procedure were to permit only one testing period during which 
all test data must be obtained, a larger number of tests would he 
required than if it were possible to make tentative assignments or 
rough sortings on the basis of a basic test battery and further testing 
to assist in making final specific assignments. 
etinm at e how many and what tess should make ра 

$ single-stage testing procedure should , 
made on the basis of two kinds of information: (1) the similarities 
between tests, as indicated by their intercorrelations, and (2) e 
differential validities of the tests. On the basis of the data reported 
in Chapter VI on the Basic Test Battery, and under the conditions 
which obtained during World War IL, four instead of eight tes” 
(exluding the radio code test) would probabl ffi à TI four tests 

; - у suffice. The 
might include one verbal, one quantitative one mechanical, а" 
one clerical test. These are the types which baye been include E 
Forms 4 and 5 of the Basic Test Battery. Whether or not such a batte? 
will prove as adequate as the longer battery formerly used i$ | 
course, subject to experimental investigation. 

For Wuat BILLETS, Ir Аму, Аке SPECIAL Tests Меерерр The arg" 
ment for a multiple-stage classification procedure such as was 3 
scribed earlier rests upon the assumption that tests designed spe? - 
cally for predicting success in particular billets are more adeguati 
than general tests used for predicting success in many billets a " 
training assignments. This assumption needs to be put to €XP б 


А те 
mental test. But there is already evidence that special tests a 
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пон i mie success in certain duties. The Navy has recog- 
—— NEEG or and has developed special tests to predict success 
onarman, radioman, and radio technician at the enlisted level. 
At the officer level, special tests include those for sonar, tactical 
radar, and radio specialist billets. Further validation of these tests 
is necessary. As classification procedures are refined, research is 
e та to discover if there are other fields where prediction could 
be improved through the use of tests specifically designed for special- 
ized purposes. 

Моор ArrrrupE Tests INVOLVING 
PAPER-PENCIL APTITUDE Trsrs FOR SOME Purposes? Studies in cer- 
tain fields which involve mechanical work, such as is taught in 
gunner's mate, torpedoman, and basic engineering schools, indicate 
that the existing paper-pencil tests of mechanical aptitude predict 
wi ue on written and identification achievement tests fairly well, 
ho to predict success if performance tests, which are designed to 
rellect proficiency in disassembling. assembling, repairing, and ад- 
Justing pieces of mechanical equipment, are used as the measure of 
achievement. Since performance tests are possibly a more valid 
renun of success in such schools than are the verbal tests, it might 

€ valuable to be able to predict scores on such tests. 

One approach to the problem would be to devise aptitude tests 
Which themselves involve performance, since in this way such factors 
45 manual dexterity can be included in the aptitude measure. The test 
Might be broad enough in scope tO include a measure of learning, 
Understanding of directions, and how to disassemble and assemble a 
Piece of equipment. Thus the aptitude test would in miniature 


re 2 Е" 

semble the learning situation existing in many schools. 

Such a test for enlisted men might be given somewhat as follows: 
a bench on which is 


te man in the group would be seated at 1 А 
aced а fairly complex and unfamiliar piece of mechanical equip- 
Pen, such as a breech mechanism from a 40 mm. gun. A sound film, 

milar to the training films in actual use would be shown 1n order 
m give standard instructions on how to dissassemble p assemble 

€ equi 3 ach of the men wou attempt to 
perform toe ae ees qmd on the test might simply be the 


tim A | 
е required (о complete the job. . " » 
any variations of the test might be tried experimentally, varying 
t of training given, and 

it might be found that more 


Complexity of the equipment. 
methods of scoring. For example: 3 
vith two showings of the film and 
for the third trial, without 


vali r 
Hen e would be obtained * 

пай, ог 0 і ште 
additional hat the time requ’ 
Additional trainine, would give best results. Some such mechanical 
Ptitude test which. involves performance might be found to predict 


PERFORMANCE BE SUPERIOR TO 


tl 
is the amoun 


the 
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actual proficiency in mechanical work considerably better than the 
paper-pencil tests. Explorations in this area are worthy of time and 
effort. 

It must be pointed out, however, that the correlations among 
various performance tests used to measure achievement in a single 
school tend to be low. High specificity of manual skills has fre- 
quently been found in studies of performance tests, and this greatly 
increases the difficulty of building a performance test which will 
predict success in a variety of situations. 

То WHAT EXTENT SHOULD PROFICIENCY Trsrs ве Usep IN CLASSE 
FICATION? Success in a given activity can, in general, be predicted 
more accurately from measures of past success in that same activity 
than from measures of aptitude or from inadequate records of 
amount and kind of experience. College success, for example, сав 
usually be predicted more accurately from high school grades than 
from “scholastic aptitude" tests. A careful analysis of the Navy class 
fication program would probably reveal neglected opportunities pd 
predicting success in a given billet from records of proficiency ЈА 
similar work or activities, 

In an amphibious training base, for example, crews were trained 
to man LCVP's ( Landing Craft, Vehicle-Personnel). Three groups : 
the crew members, deckhand, signalman, and coxswain, were give” 
essentially the same training for the first four weeks, since it wat 
desirable that any man be able, in event of a casualty, to take gie 
the duties of any other man. After four weeks, training became mor? 
ee МЕ“ men designated as coxswains spending relativ? 

e in boat i i i i ae 

blinker, etc., and бвал fn lesen ea nee an 
training, men had b i "ud ош Ee deck 
а 5, hebes een classified as coxswain, signalman, OF © 1 
Basic Test Batt " > Passe, Vision, previous experiences г" 
: . €ry scores. In this situation it ld have been 
tirely possible t ificati d oibus ¢ ў 

У Possible to postpone classification until after the first ^9... 
weeks of training and to base classification on actual ability i= °? 
naling and boat handling as determined by proficiency measures: 


d rs m г" I it was pointed out that the Basic Test Battery 
esigned primarily for use in the classi ficati so. was PE 
sibly inappropriate for use in Siiication of recruits, d 


> the selecti idates for ^ 

vanced enlisted training. It seems eie Ene "dun din суре a 
proficiency tests might be superior to the Basic Test Battery iP s 

phase of the classification program. Н 
| А number of performance tests designed to measure achiever а 
in enlisted schools are already available and could easily Ре p o 
in advanced classification cen — | 


ters. The radio-code receiving tes pip 
" | T ip 
vide a good example. Proficiency tests might also be given 9 sl 
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тои pe fne scores entered in a man's Service Record to aid in 
ен id bw eru m case of transfer from one ship to another. 
20 mum or sep oard use have been successfully developed for 
. gun crews. 

en cen of the possibilities in developing and using meas- 
i be ет proficiency of both officers and enlisted personnel 
хеб оу icting their subsequent success In the same or in a similar 

y is certainly in order. Such a project might yield evidence that 
measures of proficiency following a given amount of training or 


wes of aptitude as predictors of 


e e 5 

Бреза are superior to measu 
ccess, and that the possibilities of using such proficiency measures 
sented in Chapter XX on 


is be fully exploited. The data pre ! 
e re ationship between school success and shipboard performance 
Pport this statement. 
om MEASURES OF INTEREST AND PERSONAL ADJUSTMENT BE 
oe IN CLASSIFICATION? Over a period of years it has become 
hee evident to psychologists and personnel administrators 
indien individual's performance in his job may be greatly in- 
ind ced by his adjustment to living and by his pattern of interests 
ad ate. Some exploratory study has been done on the criterion of 
а ац on instruments and techniques for predicting adequate 
M E TAA and upon measures of interest. Most of the results, how- 
T, have been of such a tentative nature as not to be directly 
^Pplicable to the military situation. : . 
| uring the war a number of personal inventories were developed 
' used in the Navy, mainly for the purpose of screening. On the 


Fed Of scores on such tests it was found possible to reduce con- 
be interviewed by psychiatrists. In 


egative rather than positive. 


Othe 
т words, the use of the tests was П 1 i i 
ring devices might result in 


struments which could be used not only to identify the men likely 
he service, but also to aid in 
ht be especially effective in posi- 
v. This is an important area 


O measures of interests were used in the Navy except on an 
classification centers tried to 


erim 2 d 
timental basis. Interviewers at 
the expressed preferences of the 


had very inadequate knowledge 
es. There was, furthermore, an 


ехр 


Officer, a gaments consistent with 
the ла еп, but many persons 
абер yen involved in their cholc oa i utes Mee s 
glam Pt to develop preferences through the u de. 
Was orizing certain types of duty. The use of interests in class! : im 
tec at a fairly superficial level. The development and use of e a ЈЕ 
"ques for measuring interests and attitudes and relating them 
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classification of naval personnel might lead to fewer requests for 
transfers and to better adjustment of each man to his job. — 
WHAT PERSONAL History ITEMS ARE VALID FOR prs n cud 
A considerable amount of personal history is routinely obtainec p 
entered on the records of all Navy personncl. Sample items "i 
previous military duty, amount and kind of сопран паран 
training, occupational experience, leisure time acüvities, Ы! ship 
talent for public entertainment, and highest position of ee ee 
(Chapters II and III). The classification interviewer or паре 
officer evaluates this information subjectively in making his 1n! * 
recommendations, and the information is recorded for later use * 
making assignments aboard ship or at advanced classification cer iy 
The usefulness of these personal history items has never been dt 
demonstrated. For populations already selected on the basis of iD 
Scores, it has been shown that age and amount of civilian educat a 
have little correlation with school success or performance e 
ship. Type of education (technical, general, or vocational) has tied 
been carefully investigated, and civilian occupation has been stuc i 
only superficially. A more careful investigation of these factors nd be 
reveal that the predictive value of personal history items io des 
increased through refinements in evaluating and recording aes 
It might be found, for example, that refinements could be per 
duced into the recording of occupational data so that the Qr 
skills involved in the civilian job (administrative ct, sul 
inality, proficiency in the use of 
be related more definitel 
Can 


ability, ta 
specific techniques and tools) co 
y to the Navy jobs. m 
THE INTERVIEW CONTRIBUTE To MORE EFFECTIVE Cras e 
CATION? In the early part of the war, classification was patur. 
almost entirely on the basis of data obtained by testing and by a of 
tionnaire forms. The procedure was often criticised for its Qr of 
the more personal type of evaluation obtainable through the aa af 
interviews. The procedures were later revised, and a number ng 
classification interviewers were trained and put to work intervie™’ 
each recruit and making recommendations as to his assignme? ; 


. B a su 
similar procedure was followed in the case of officers. The qu fre 
of whether the interview results in better classification Ра few 
quently arisen, both in militar 


1 y and civilian experience, 
studies have been made to obtai 


in an answer, А ewe. 

One study concerned with the reliability of the interv! + Uit 
ratings of recruits was carried out. Another study dealt WS adf" 
validity of the quality ratings assigned to each recruit by Фе, wind 
viewer (Chapter XII). The lat 


" -yle 
ter study suggests that mer 10 
actually detracted from the Success of the procedure; ассот 
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this study, assignment to a service school on the basis of test scores 
alone would result in a more successful classification than assign- 
ment on the basis of interviewers recommendations. Additional 
studies are needed for both enlisted and officer programs. 

It is possible that such studies would verify the finding that, as 
at present used, the interview is a relatively ineffective classification 
technique. Present knowledge suggests that interviewers tend to 
Weight too heavily the items of information which they themselves 
Obtain, at the expense of aptitude test scores. A standardized pro- 
cedure, called a “point score" method, was developed for aiding the 
Classification interviewer to evaluate the various factors involved in 
making recommendations concerning the assignment of recruits. In 
this procedure uniform weights are assigned to carefully selected and 
explicitly stated factors. The use of such methods is probably more 
Teliable and objective than the ordinary interview evaluation. The 
Validity of such a procedure depends entirely upon the care with 
Which the factors are selected, defined, and weighted. The results of 
Validity studies of personal history items should be used to select 
the interview factors to be used and to establish specific rules for 
their weighting. More rigid requirements might also be set up. for 
the application of test scores in evaluation. Factors and weightings 
would need to be determined and verified for specific schools and 


for various billets. - : . 

he suggestions here given for improving the interview tend in 
the direction of making the interviewer follow definite rules in 
recommending асри If followed to its logical conclusion, this 
tendency might lead to dispensing with the interviewer and using 
Machine methods entirely. If efforts to improve the interview fol- 
Owed a different course, the conclusion might be that better 
Methods of selecting and training interviewers would improve classi- 
lcation without introducing ihe mechanization of procedures. The 
"esearch has not as yet gone far enough to predict which approach 


Wo " vim 
"ld ultimately lead to greatest improvement. 


Research on Techniques of Training 


aie objec of mary азн it роб а р ДЕ 
thes officers and men well-qualified to carry Gub bae ссе a ts 
sh У will be assigned. The object of а training researc aper: | 
Seria therefore, be to provide essential information M ko і 
чел directors of training programs in determining what should 26 
neht what specific teaching techniques would be most effective in 
tous types of training, how long а training program 15 required, 
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how instructors should be selected and trained, how the motivation 
of trainees can be improved, and how effective the training program 
has been. 

During World War II little research on training, other than 
that directly concerned with measurement of achievement, was сат 
ried to completion in the Bureau of Naval Personnel. The work of 
the Billet Analysis Section provided extensive and valuable inform 
tion for the writing of curricula, but little in the way of concrete 
research results on curriculum methods was available. Accordingly: 
the naval training programs were planned on the basis of the best 
guesses that could be made by experienced naval officers and civilia? 
educators. Except for work on methods of teaching radio code, ver? 
little research was done on the techniques of teaching. d 

In planning a research program on the problems of training: i 
very Important to keep in mind the critical situation obtaining 10 
emergencies, Solutions which may be adequate for peacetime oper® 
tons sometimes prove totally unadapted to the needs when large 
oe of men are being inducted and must be trained in А 
toe to man newly commissioned ships a! ae 

Curricula mist e! my expert maintenance and on devel 
Nice an gc cai planned in terms of the latest technica wl 

perating doctrine. Adequate provision must be 


H (ET m 
А on retraining of experienced personnel as well “hose 

ot thal training of large numbers of recruits and inductees W ies 
civitan experiences may bear more or ] 


l i i the E 
for which they must be trained. Plans wee c m the alle 
es and efficient use in training installations of equipment wh val 

cing installed on ships. Methods of selecting and training 
m serve as instructors and training officers in service 8С (ђе 
г ey st eee Training techniques and training aids MY’ jn 

nee and evaluated in terms of their comparative есас то 
bringing e the desired learning results. The training ese 
ed ара provide nomad hh a Y 
for a rapidly ex ne the development of training P” 

Tho Jet аб teint o ЈЕ 
aniio i training research problems which follows сот c call 
f pied indefinitely. Each question could be asked spe. (ве 
or each training program that exists now or is likely to exist n 
event of another emergency. icd тре 

How Can тне EFFECTIVENESS OF TRAINING BE EVALUATED ai 


f 
> quality control of personnel and to all ^5 у 
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e » Hi grits pec: may be useful in the advanced classifi- 
selection E as criterion instruments for evaluating 
Ein RORIS. леу also serve as valuable incentives in moti- 
ing both trainees and instructors. 
is m pom s trainees in the job for which they are trained 
е eje criterion of the success of a training activity. (For 
XIX) с. hs characteristics of an acceptable criterion, see Chapter 
duty Д ha ess adeguate criteria of school success and of success 1n 
Кок бине available, the results of experimental studies on training 
usd as s may be quite misleading. For example, if essay tests were 
ficant m criterion of success in gunnery school, statistically signi- 
imer: ence might be found that training in expository writing 
Ridicul essential than practical work in range estimation or loading. 
пег ous as this illustration is, parallels can be found in actual 
their ES The criteria of successful training must be as valid, and 
e рае Бе аѕ reliable as 1t 15 possible to make them. 
ing “а stable valid criteria, the validity of techniques for measur- 
of снезе of instruction and of studies on the effectiveness 
ing courses and methods must remain in question. 

а есем work has been done оп the development of methods 
thë us asuring the effects of training. Methods so far devised include 
Aur =, of tests of various kinds and of ratings both of performance 
Hugo. Mdh constructed during training. But this work has been 
fio ed to relatively few of the training activities 1n the Navy. 
tie ари devices should be developed for use in areas 
ave not yet been studied, and new techniques of measure- 


m s 
€nt should be evolved where necessary. A method of evaluating 
nly be valid and reliable, but 


large numbers of trainees can 
e. In addition, it should 
he critical elements in the 
he most significant objectives 


the train; Fe 
'^e training program, and the relationship must be apparent to 
f the present measures of profi- 


raini А the improvement of evaluation of 
гена is the development of performance measures of higher 
ing ity than has yet been attained. For many of the Navy's train- 

Programs, skill in the choice and application of techniques 15 


of 
ip Seater significance than verbal knowle 


acc 5 : 
оттар аР lishment. The observation anc · 
SEY псе on such tasks requires more skill on the part of the ob- 
P and scoring of an objective-type 


an does the administration 
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5 uate 
test. The selection of Tepresentative tasks to pA "e win ets 
sampling of the needed skills is complicated. ч ( ) iso орат 
specificity (or lack of transfer) of the skills which cor ‘vidual ees 
rating, and (2) the lack of instructor time to give in —— 7 
tion to the observation of test performances. The result is | which 
to resort to rating or the development of short tests, both sini 
fail to provide an adequate range of discrimination op estrit 
Averaging these ratings or short test scores tends ние ет cdi 
the effective range of discrimination. Development of relia opment 
niques for appraising performance may involve the deve Pather 
of synthesized or integrated units in both teaching and scien 4 EX 
than the type of analysis which has characterized written eld be 
perimentation in this area is one of the programs which sh 
given immediate attention. fa train 

Once a satisfactory criterion for evaluating the success 0 ну o 
ing program is available, the way is open to introduce a ber An 
studies on such problems of instruction as curriculum, met . dh spe 
motivation. Probably separate studies will be required for ca 


ге 
| мента А. natur 
cific type of training, since these problems grow out of (1) wd (2) the 
of the teaching objectives and content of the program, an 
preparation and n 


eeds of the trainee population. крои 
How Can Моке ЕРРЕСТТУЕ CURRICULA AND TRAINING Srt 
BE PLANNED? Basic to any study of curricula and schedules s o! 
fic schools is a consideration of the general pattern of train ater 
the naval service. As indicated in Chapters IV and V, the dod of 
of training followed during the war provided for an initial Py dut? 
indoctrination followed by elementary training in schools wae would 
assignments in which it was assumed that in-service iste “ 
be carried on. Advanced and Specialized training was prov епс 
schools, usually after the trainees had had some sea Ed to p 
Operational training provided for the adaptation of skills ^ а o 


4 tte. 
equipment and the development of team efficiency. The p? onte” 
training proposed for enli 


plates an additional type 
gram and elementary tr 
schools are designed to 
what related billets or r 

Since research on cur 
a number of question 
problem will be raised 

In the long run, wou 


atings. ny acer 
ricula and training schedules has eq he 10 

5 dealing with different aspects of ot 
in the discussion which follows. cien! fj 
ld training aboard ship be more eff Py 
certain billets than training ashore? During a period of n for со 
zation, shore training is necessary because ships are пееде er” 


: ; qn 
bat. There is evidence that shore training is better than 
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ет ka eme men for their duties in some billets, and it is 
five or lew ins certain other types of billets shore training is ineffec- 
bu а dn samye than shipboard training. If this should prove 
madifission s! арм must be made for training ships or for 
ае n shore training so that it will more nearly ap- 
tond k oard conditions with respect to whatever factors are 
of the de 3 important. For example, in gunnery training the motion 
Which th " хан Ъе simulated by the use of a movable platform on 
die tr pa pieces are mounted. Among the specific problems 
Ti а which require further investigation are the following: 
Bikes oe xtent can the training for each billet or job be carried 

= esce: ganized schools ashore? What skills can be developed only 
заа rom in the billet afloat? For what schools should sea ex- 
ttainins i prerequisite? To what extent 1s shorebased operational 
rtis e ective? Should personnel be sent directly from recruit 
lado се indoctrination school into technical training ог would 
more eff elementary training for billets be better motivated and 

ective if a period of sea duty were interspersed? 


What is the optimum length of а training program? The length 


Of specific Д - E 
Ресібс school programs has varied greatly during the war. Radio- 


“aa niig was initially 20 weeks but was reduced to 16 weeks. 
shortes training was varied from 3 to 12 weeks in length. The 
тем period of training that is consistent with satisfactory per- 

ce needs to be determined for each training activity. The 
ograms depends upon both 
f instruction and the devel- 


9pme 
nt of adequate measures of progress and of competence. Con- 
ding upon the previous 


сеју 
mainte Programs of variable length, depen 
ne and aptitudes of trainees, may result. з 
much specialization in training 15 desirable? In the ele- 
aseni gunner’s mate schools, men were trained in the disassembly, 
tom у, maintenance, and repair of various types of guns, ranging 
small arms to the 5”/38 dual-purpose rifles. For the majority 


of 
ecd men, much of this training was wasted. Those assigned to 
50 landing craft had no occasion to work on guns larger than the 
i large ships would or- 


erar machine gun. Those assigned to 
5”738 и е assigned to only one type of gun, 20 mm., 40 mm., or a 
ida ~ f the men could be selected and earmarked for assignment 
ктай, ticular type of gun, it would be possible to shorten the 
With ie. 5 period and probably to increase the efficiency of the trainee 
n €spect to the gun to which he is assigned. 

With the other hand, it can be argued that the Fleet needs men 
men в broader background of training. Perhaps 1t 15 better to train 

Or severa] related billets permitting them to choose or be 


men 
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remen- 
personal characteristics. This situation may E due o poc 
dous variety of civilian teaching positions and t He am at the devel- 
philosophies. Since Navy training programs "ACA S possible 
opment of rather specific knowledges and skills, i d teachers 
that research on the identification and description of 500 iom 
may be more fruitful in the Navy than in civilian. ом 
In considering the problem of selecting and training g^ it 
personnel, three important facts must be kept in mind. nected 
should be remembered that every officer and petty officer 1s id. ining 
to assume responsibilities in connection with the in-service а | yetty 
program; hence there probably is a communality between xem is 
officer qualities and good teacher qualities, Second, since be pos 
considerable variety in Navy training, it probably will not sti 
sible to pick good teachers generally. It seems unlikely, for суза du 
that a good recruit training instructor could be described пење 
same terms as an instructor for an electronic technicians $5 me 
Third, the Navy will continue to rotate men between pnr 
shipboard duty, hence it will not be possible to select pem 
school instructional duty only. In other words, Navy instruc ible 
both officers and enlisted, must be selected from among those elig 


: : * ntually 
for shore duty, and personnel serving as instructors will eve 
return to sea duty, 


The three major rese 
with the selection and tr 
can the skillful and uns 
words is the problem of 
background characterist 
in a specialized field is 


10 
: iom fup connetti” 
arch problems which arise in con í 


"oe rsonal а 
the criterion. (2) What are the perso! etent 
ility 
d 


wel f 
hese problems can be obtain jew? 
i but in V^ 4 10 


: jn 
n, sufficiently unique to warrant ! Е 
study within the naval service. 


£5 
INÉ 
How CAN THE MORALE AND Motivation or ScHooL TRA 
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IMPROVED? The principal factor in the maintenance of morale and 
a high degree of motivation in the Navy’s schools during the war 
Was the anticipation that there would be immediate need for 
trainees to apply their newly learned skills and techniques and 
knowledges in situations where consequences of failure would be 
extremely grave. Men knew that their own survival, that of their 
shipmates, and the success or failure of their missions might depend 
оп their ability to do the right thing in the right way at the right 
ume, Even under this compelling pressure, there were influences 
Which made for unsatisfactory morale. Since the end of hostilities, 
these influences have grown in importance. 

During the war a large number of morale studies were made by 
the Army and a few by the Navy. "These studies indicate that the 
morale factors generally effective in the services were (1) satisfaction 
With the job, (2) belief in the mission, (3) a realistic appraisal of the 
Job ahead, (4) confidence in the training and equipment, (5) pride 
in one’s unit or organization, (6) belief that one’s individual welfare 
Was a matter of concern, (7) relations between officers and enlisted 


Men, and (8) faith in the cause and in the future. | 
отаје among trainees is influenced by these factors in a way 
Peculiar to the training situation. Men who had enlisted in the ex- 
Pectation of immediate sea duty and combat action were not satis- 
ied to be put in schools. Sometimes the instruction and equipment 
did not warrant confidence, and trainees were likely to recognize 
p adequacy and superficiality more quickly than their instructors. 
"ride in organization is difficult to maintain in a training station, 
кэн there is а feeling that, however necessary training may be, the 
и of a trainee is inferior to that of the man on operational 
fat Furthermore, trainees often fee] that they are та napaea! 
5 they look upon their school period as an interlude " о 
~ develop a feeling of ae a the training group. a 
and relationships are somewhat complex in school situations, ап 
> alnees frequently do not know to whom they can take their prob- 
‘ems, Consequently they feel that по one is interested in them as 


dividuals. | 
morale among trainees 


any ways similar to the prob- 


Problems include the presence OF 57. 1 tere 

the ] bject matter, participation by the trainee in the activities of 

fu], o ning process, knowledge of progress made, belief in the use 

le 

tibus of the learning material, and other such elements which con 

= i i ning. 

€ to good teaching and efficient lear oe 
Continuing program of morale appraisal is needed. 


the Sti 
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populations turn over rapidly, and there are frequent changes in the 
personnel assigned to training school staffs. Care must be exercised 
in determining the causes of unsatisfactory morale. Different causal 
factors may result in the same expressed grievance. Remedial and 
preventive measures must relate to causes rather than to symptoms 
if they are to be effective. 

Research on improvement of morale and motivation in the Navy 
schools should be directed toward the development and validation 
of (1) means of discovering unsatisfactory morale conditions before 
they emerge as overt symptoms, (2) techniques of identifying the 
causes of unsatisfactory morale, (3) remedial measures, and (4) pre 
ventive practices. 

Some work has been done on the development of attitude and 
opinion surveys designed to discover causes of discontent in the serv 
ice at large and to obtain an evaluation of training by forme 
trainees who have served in billets for which the training was de? 
signed. It has been found that achievement tests given at appropriate 
intervals serve to keep the trainees aware of their progress and sup” 
ply incentives for serious effort. Speed tests of performance have 
been particularly effective in producing competition among trainee? 
While these devices are helpful, they are far from adequate for 

The development and use of attitude and opinion measures © 
не and school staffs might prove helpful in determine 
rdi hae ees a inig sta 1 f in peo 
training might ес и i of men for assignment te atio" 
ере ти ith амабје in the maintenance of mot ;bilitY 

Ep with values of team training and group respons! 
might also prove useful. 


It is likely that the morale pr i ed 

| that problems in the schools of the P“ сд 

Ба Navy will differ considerably from those which were 0Р8 пре 
ет чај а Efforts should be made, therefore, to St" 7 dies 

0551 i i | | 

possibility of adapting the findings and techniques of morale ds of 


in industry and of motivati ies i и 
а ation studies in i the ne 
the naval service. jinta 


tions. The use o 


Methodological Problems 

o? 
ed cei research was accomplished during the t P 
ms of training and of selecti ification Yere 8 
formed under the јен Eth and «даланю fer^ d 

с : a 
al id шиши with the personnel procedures already in " rae 
outines already established. Such considerations аге 9 war 
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well be argued that one of the primary purposes of a military or- 
ganization in peacetime is to study and perfect its own organization 
and procedures; this is essentially research. In the material that fol- 
lows three significant methodological problems are discussed briefly. 
CAN SATISFACTORY CRITERIA OF SUCCESS IN PERFORMING MILITARY 
Durtes ве DeveLoprp? Evaluation of the techniques used in classify- 
ing and training men for military duties depends upon the existence 
of valid and reliable measures of the success with which men selected 
and trained in accordance with specified techniques enter upon and 
Perform their duties. This fact has already been stressed (Chapter 
XTX), but it cannot be too strongly emphasized that unsatisfactory 
Criteria of success may and sometimes do lead to research findings 
that are seriously misleading. 
The validation studies reported in previous chapters have used 
45 criteria school grades, achievement test scores, and rankings and 
ratings of various kinds. Are these measures acceptable as criteria? 
n Many cases one is forced to conclude that they are not; pertinent 
Phases of performance are omitted, or the weight given to signifi- 
Сапе factors is not in accordance with their real importance, or 
€xtraneous factors are introduced, ог the measures Jack consistency, 
ОБ they fail to provide an adequate range and precision of discrim1- 
Nation, 
oe techniques of measurement used in ct aS ae = 
eria will necessarily vary from one type о do poris 
pou practical performance tests may bé satis weis ur Яа 
to ances. In others it may be necessary to devise rating У p 
be cmbark on а program for the training of raters. New devices + 
needed: f tion picture photography might е 
Used 1 Ad example, mu p i ја be reviewed by 
s in obtaining permanent records which could be ew: у 
anels of ex 1 ‘hich could be used in the training © 
Taters, xpert judges or wht 
The 
Solve а 


Most important single problem of method Mee d x i 

Js the development of satisfactory criteria of success. que 
Criterion should be undertaken at the very beginning at E 
Development or research project, and under «Ане poss 
tion Wi. development be postponed pela expe 

training methods have been GeV" x 
the x W CAN THE DrsicN OF EXPERIMENTS BE ian AR а | 
hin evelopment of acceptable criterion measures, the ca pl T 
8 of the design of experiments is of the highest importan: 


ve E ER 
Prosecuti rogram. In the validation WO 
У tion of а research ргов it was not feasible to estab? 


led i = 8 
li on in the Navy during the wa” a. 29) 
Sh а €quate control лапу A test the efficacy of € ein, Д 
‘raining procedures which were experimentally теор 
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x : re pri- 
marily empirical rather than experimental. Fo Е х: ава only 
validation studies on selection tests, data could be насљеђа 
for groups that had already been selected by whatever eee 
were in use at the time, making it necessary to apply ma lun git 
corrections for curtailment in range of scores on the select о риз 
being studied. For experimental purposes it would be Pa поене 
desirable to plan a series of experiments in which p) range off 
to training activities on a random basis, so that the fu election 
talent could be represented. The relationships between is fully 
measures and measures of achievement would then be mO factors 
apparent, and one could state with greater confidence which f 
are most important for success. а with 

Experiments on training programs should be conducte Low? 
groups of men carefully matched with respect to the А with 
to be important for success in school. Only when the variabi a ents 
respect to initial ability is carefully controlled can the wee tn for 
of various types of training be compared. It might be desira experi 
a period of time, to earmark a large proportion of recruits as a uii 
mental subjects. These men would be distributed to на ре 
duty in various schools and operational activities ashore a ficatio® 
in accordance with the plans of the experiments in classi ae 
and training techniques. Their experiences in the Navy WO ously: 
carefully controlled, recorded, equated, and compared. ОБУ е 


E а - from А 
such assignment and control procedures might detract ћ expe! 
immediate operational efficiency of the units to which the СР -g 
mental personnel were 


assigned. On the other hand, such е he 
perimentation can be carried on only during periods of pea б be 
temporary loss of operational efficiency during peacetime ee can 
a small price to pay for the development of procedures кее jon 
be relied upon to increase the speed and efficiency of mob! qiie 
and training when such speed and efficiency are extremely 
factors. 


ARE THE FINDINGS oF PEA 
WARTIME SITUATION? Since t 


^ 
то, 

X 
CETIME RESEARCH APPLICABLE р і 


А seatt ба 
he real test of the peacetime Te ining a 
whether or not it leads to more efficient classification and tra th 


Ea o e : ten - 
an emergency, it is highly important to know to what €Xt* olu 
findings of research conducted in 


tion of wartime personnel 
cast some doubt upon th 
search to wartime probl 
teristic abilities and aptitudes 
under the two conditions, and 
men toward military service und 


: о 
of the service personnel oad s 
(2) differences in the at 

er the two conditions. 
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If a consider. Я ; 
FO colle mfi d 56 Боне service program, there will be less 
cae acl, anions E gene and aptitudes of the peace- 
between their ae ul мй ‘li d "re ipie: 
еј, the: personna ward military service. If, as seems more 
ins an за ne of the peacetime Navy is obtained by volun- 
На авина , ANNUS differences may be found in such 
training, i" n = occupational experience, amount of school 
toward militare E ike; but the attitude of the volunteer group 
Hh attitude pa = would likely be more nearly comparable to 
ite ene ome ing during the war years. | 
plicability et "e raa problem of determining the extent of ap- 
researche. Con n реч findings would be to repeat some of the 
On the те imi eted during the war. If similar results are obtained 
üpported s e studies, the presumption of applicability would be 
oss das е more carefully controlled studies in the same areas. 
the oe differ materially from those previously obtained, 
and degree of difference may indicate a means of devel- 


ps: 

y ke ques of adaptation. 
of tarch, Ta which may affect t 
there are r си я for some time to 
Not had relatively few men 1n the 
lose dake ak a previous military exp 
nowledge z the fact that techniques 
illets Ride up in civil pursuits to ! : 
itute an important factor in an efficient program of 


mobil; 

ilizati eme 

em А The Navy's personnel research. activities should not, 

re, be confined too closely to the study of its own require- 
used and the research carried 


men 

on E pd practices. The techniques ae А 

Mdustr n with selection and training 1n education and 

to the y should be continuously observed, and their applicability 
needs of the Navy should be explored. 


he validity and the applicability 
come derives from the fact that 
90 to 30 age group who have 
erience. The Navy should not 
for the adaptation of skills and 
to the requirements of service 


ve been outlined in this 
o general types: (1) those 
f techniques of measure- 
best investigated in the 


Solut; 
S oe for the problems which ha 
a lest. 1 require research studies of tw 
Dent and character, such as development 0 
aborator analysis which can perhaps be t 
tions aff y situations which some universities and research organiza- 
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Civilian research had succeeded, before the war, in developing 
valid and reliable measures of verbal, mathematical, and mechani- 
cal aptitudes. These subsequently proved their worth as techniques 
in military classification and selection. In certain other phases of 
aptitude testing and in the appraisal of personal qualities, basic 
research had not yet developed sufficiently effective techniques. 
When the necessary fundamental research on the measurement of 
personality factors and interests has been accomplished, it will ре 
haps be possible to use such measures more effectively in the military 
situation. The experience of World War I greatly stimulated те“ 
search in the measurement of intelligence and aptitudes. A similar 
increase in research on problems of the measurement of personality 
factors may be expected to follow from the needs for such measures 
which were demonstrated in World War II. 

'The lack of a carefully planned systematic approach to the study 
of the Navy's personnel problems before and during World wa 
II may be corrected by the establishment of the Research Activity 
of the Bureau of Naval Personnel (Chapter 1). Techniques аге 
already available for carrying out necessary research on many phases 
of the selection, classification, and training processes. As prove 
techniques for study of the problems of welfare, morale, perso”? 
adjustment, and other factors in the administration of personn^ 
management are developed, these problems can be accorded the 
attention which they deserve. 
will develop der oly пайм рсе e wes anc 
divo che requin Oe in will progressively ent ems 
which will continu a solution of n лају, 

€ to arise. It cannot ђе emphasized too 5:70. 55 


however, boe adequate solution of the Navy's personnel pro "m 
requires the systematic planning and prosecution of a comprehen? 
research program. The aims o a 


f this program should be to dev. e 
and prove the techniques which wil eden effect” 
as a fighting force by enabling itt make the Navy up р 


me 
t to mobilize in a minimu™ 
with the least possible waste of manpower. 
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General Classification Test 
General Classification Test 
Arithmetical Reasoning Test 
Mechanical Aptitude Test 
Electrical Knowledge Test 
Mechanical Knowledge Test 
Clerical Aptitude Test 


2. Special Selection and Classification Tests 
Enlisted Qualification Test (WR) 
English Test 
Non-Verbal Classification Test 
Literacy Test 
Applicant Qualification Test 
Airplane Matching Test 
Mechanical Comprehension Test 
Winchmen and Hatchmen Selection Test 
Radio Technician Selection Test 


Appendix B 


ог 


Billet Preference Record 

Billet Qualifications Blank (Men) 
Billet Qualifications Blank (Women) 
Enlisted Personal Inventory 

Enlisted Personal Inventory 
Experience Comparison Index 
Personal Check List 

Personal Inventory 

Previous Duty Check List 

Social Judgments Test 


Fleet Edition Form 1 
Fleet Edition Form 1-5 
Fleet Edition Form 1 
Fleet Edition Form 1 
Fleet Edition Form 1 
Fleet Edition Form 1 
Fleet Edition Form 1 


Form 4 

Form 1 

Form 1 

Form Х-1 

Forms 1, 2 

Form 1 

Mark 3 

Form X-1 

Forms 6A, 7A, 8A, 9^ 


- Inventories and Psychiatric Screening Devices 


Form X-1 
Form X-2 (M) 
Form X-2 (W) 

Form 1 
Form 2 

Form xd 

Form x4 
Form X-1 (W) 

Form x1 

Form x 


Advancement Examinations 


Fundamental Knowledge Required of all 
Men in the Navy 

Seaman 

Coxswain 
Boatswain's Mate 
Gunner's Mate 
Turret Captain 
Mineman 
Torpedoman's Mate 
Quartermaster 
Signalman 

Fire Controlman 
Fire Controlman (0) 
Yeoman 
Storekeeper 
Hospital Apprentice 


One Test 

Test for one pay grade 
Test for one pay grade á 
Tests for three рау grat Я 
Tests for four pay gr ^ 
Tests for two pay geo. 
Tests for four pay gr? es 
Tests for four pay 8725 ps 
Tests for four pay Er cs 
Tests for four pay 87 aes 
Tests for four pay Er ac 
Tests for four pay 8? des 
Tests for four pay ges 
Tests for four pay 8? 
Test for one pay ртабе 
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Pharmacist's Mate 
Ship's Cook 
Baker 
Commissary Steward 
Radioman 
Radio Technician 
Radarman 
Sonarman 
Carpenter's Mate 
Shipfitter 
Machinist's Mate (S) 
Fireman 
Machinist's Mate 
Motor Machinist's Mate 
Electrician's Mate 

ater Tender 
Boilermaker 
Aviation Machinist's Mate 


Tests for four pay grades 
Tests for three pay grades 
Tests for three pay grades 
Test for one pay grade 
Tests for four pay grades 
"Tests for four pay grades 
"Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Test for one pay grade 
Tests for four pay grades 
Tests for four pay grades 
"Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 


Aviation Machinist's Mate (C) 


A 


Aviation Machinist's Mate (F) 
viation Machinist's Mate (Н) 


Aviation Machinist's Mate (I) 


Viation Machinist's Mate (P) 


"Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 


ман E in; 
ation Electrician's Mate 


Vlation Radioman 
iawn Radio Technician 
viation s ctalsmith 
vasi ü dnanceman 
10n Fire Controlman 


viati ; 
; Yatton Ordnanceman—Bombsight) 


Vlation Ord 

nanceman (T 

Parachute Rigger i 
9tographer's Mate 


Tests for four pay grades 
"Tests for four pay grades 
"Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 


"Tests for four pay grades 
Tests for four pay grades 
Tests for four pay grades 


Achievement Examinations 


OFFICER TRAINING PROGRAM EXAMINATIONS 


l. Us 
3. Nav 
a 


Seaman 
E 


rdnance апа С: 
" unne 
Navigation Ы 
2. 


CIC Fj и 
d Achievement Examination 
adar Final Achievement Examination 


re-R. 


a ship and Communications 
Bineering and Damage Control 


Othe " 
T Officer Achievement Examinations 


^ 1 Reserve Midshipmen's Schools (Deck), 
andardized Examinations 


Form I (and Form I, Mod. 1) 
Form I (and Form I, Mod. 1) 
Form I (and Form I, Mod. 1) 
Form I (and Form I, Mod. 1) 


Forms 1,2 
Forms 1, 2, 3, 4 
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ENLISTED TRAINING PROGRAM EXAMINATIONS 
1. Basic Engineering (Class P School) , T" 
Written Final Achievement Examination Forms I, П, ПІ, 
Performance Tests 
Auxiliaries 
Boiler Maintenance 
Evaporators 
Hand Tools 
Hand Tool Gages 
Instruments 
Internal Combustion Engines 
Operation (Fire Room) 
Piping 
Pumps 
Refrigeration 
Ship Fitting 
Tracing Pipe System 
Turbines 
Valves 


- Diesel (Motor Machinist's Mates—Class A School) 
Written Final Achievement Examination 
Performance Test (Diesel Engine Operation) 

+ Electrical (Electrician's Mates—Class A School) 


Forms I, П, UL IV 


I 
Written Final Achievement Examination Forms I, II, III, IV, У, Я 
Performance Tests 

A-C Equipment and Interior Communications 

Wiring 


D-C Equipment 
· Fire Controlmen (Class A School) 


Written Final Achievement Examination Forms Í 2 

5. Gunner's Mates (Class A School) vi 
Written Final Achievement Examination Forms I, II, III, IV, V. 

Performance and Identification Tests 11 

Performance Tests (Final) Forms ni 
Identification Tests (Final) md 


Performance (Unit) Tests 
5”/38 Performance Test 
40 mm. Performance Test 
20 mm. Performance Test 
-50 Caliber Browning Machine Gun Performance Test 
Small Arms Performance Test 
Identification (Unit) Tests 
5"/38 Identification Test 
40 mm. Identification Test 
20 mm. Identification Test 
-50 Caliber Brownin: 


g Machine Gun Identification Test 
Small Arms Identifi 


cation Test 


6. 


~ 


15, 


Lists of Examinations 


Gyro Compass (Class C-1 School) 
Written Final Achievement Examination 


- Lookout 


Written Final Achievement Examination 


* Quartermasters (Class A School) 


Written Final Achievement Examination 


· Radio (Class A School) 


Written Final Achievement Examination 
Performance Tests 
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Forms I, II 
Forms I, II 
Forms I, II 


Forms I, II 


Radio Code Receiving Examination, Directions for 


Administering and Scoring 


Record No. 1. Directions to Trainees and Practice Tests 


Record No. 2. Message Tests 

Record No. 8. Plain Language Tests 

Record No. 4. Plain Language Tests 
Equipment Operation Tests 


* Recruit Training 


Jri : " А А 
Written Final Achievement Examination 


» Signal (Class A School) 


Written Final Achievement Examination 
Performance Tests 

Flashing Light Receiving 

Flashing Light Sending 

Semaphore Sending 

Semaphore Receiving 

Flag Hoist Spotting 

Flag Hoist “Bending On” 


- Special Training Program 


Reading Achievement Examination 
сад те Classification Examination 


à Storekeepers (Class A School) 


Titten Final Achievement Examination 


` Torpedomen (Class А School) 


i Final Achievement Examination 
nr висе Tests (Final) 
rtormance Tests (Period) 


Yeomen (Class A School) 


са Final Achievement Examination 
Tiormance Tests 


Forms I, II, III 


Forms I, II, III, IV 


Forms I, II 
Forms A, B 


Forms I, II, III, IV, V 


Forms, I, II, III, IV 
Forms A, B, C, D 


Forms I, II, III, IV, V 


Irections for Administering and Scoring Typewriting 


Forms I, II, III 


Direction; for Administering and Scoring Shorthand 


Forms I, II, III 
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16. Spelling 


i I 
Spelling Achievement Examination Forms 1,1 
17. Telephone Talker - 
Telephone Talker Final Achievement Examination Forms 1, 


Check List for Correct Handling of Sound-Powered Telephone 
18. Radio Technician Training 
Pre-Radio Materiel Achievement Examination 


Forms I, II, III, IV, V, VI 
EE and RM Final Achievement Examination 

Forms I, II, III, IV, V, VI 
19. Radar Operators (Class P School) 


5 а : B x В 
Written Final Achievement Examination Group І, Forms A, 


Group II, Forms A, d 
Group III, Forms A, 


Technical Personnel and Research Aids 


А. TECHNICAL MANUALS 


Constructing and Using Achievement Tests 
(A Guide for Navy Instructors) 


Insert A: Example for Naval Training School (Gunner’s Mate) 
Insert B: Example for Naval Training School (Electrical) 


B. RATING SCALES 
Teacher Trainee Rating Sheet 


Radio Materiel 
Teacher Trainee Rating Summary Sheet (Radio Materiel) 
Instructor Rating Scale (Radio Mater 10 
Radio Technician Rating Scale (Radio Materiel) Form 1 (Revise 
Petty Officer Rating Scale (Radio Materiel) For™ 


С. INFORMATION SURVEYS 
Information Survey 1 (questionn 

A Study of Enlisted Training 
Information Survey 2 (questionnaire) 

A Study of Educational Services 
Information Survey 3 (questionnaire) 

A Study of Amphibious Forces Personnel 


aire) 


APPENDIX C-1 


LIST OF RESEARCH PROJECTS COMPLETED BY THE TEST 


о 


" 
Sowers ge 


ll, 
12, 


13, 
14, 
15, 


16, pe 


17, 


AND RESEARCH SECTION * 


Officer Personnel 


STUDIES OF TESTS 
Sex, regional, and part-score differences in Officer Qualification Test 
(Form 1) scores. 6 
Summary of scores made on the Officer Classification Test by Reserve 
Midshipmen and Indoctrination School classes. 


PREDICTION AND VALIDATION STUDIES 


Prediction of success in Pre-Radar Training. 
Analysis of Officer Qualification Test scores of successful armed guard 
Officers, 
Prediction of success of Tactical Radar Officers. 
rediction of success of Fighter Director Officers. 
Prediction of success in a Naval Reserve Midshipmen’s School. 
Prediction of success of officers assigned to special aviation billets. 
Validation of officer selection requirements for destroyer billets. 
alidity of selection requirements for motor torpedo boat officers. 
alidation of selection requirements for amphibious (LSM) officers. 
Nalysis of the relationship between scores on certain parts of the 
cer Classification Test and mid-term examination grades of 
“serve Midshipmen. . 
alidation of selection requirements for submarine officers. 
alidation of selection requirements for Torpedo Data Computer 
Operators. 


p.e diction of success in Construction. Battalion. Officer Training 


rogram, 


Factors associated with success of officers assigned to duty on assault 
‘Transports, 

reliminary report on the validity of the United States Navy Officer 
assification Test for predicting success in Pre-Radar Training. 

o iminary report on the validity of the United States Navy Officer 
ing ation Test for predicting success 1n Diesel Engineering Train- 
Validity of the Officer Classification Test in selection and placement 

Officers in Gunnery and Fire Control School. 


esi Е б Ps 
© Studies are unpublished and are not available for distribution. 
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466 Appendix C-1 


- 


- 


— 


Ae 


12. 


13. 


. Basic Test Batter 


· Prediction of success in N 


. Validation of age and 


- The use of the Non 


· Analysis of Ortho-Ra 
. Relationship between qu 


. Analysis of selection re 


. Elementary Service $ 


· The validity of the United Sta 


. The USS New Jerse 
. Relationship betwe 


OTHER STUDIES 


- A study of the performance of junior officers aboard ship. 


Enlisted Personnel 


STUDIES OF TESTS 


- Studies of scoring accuracy on Basic Test Battery. — 
. Trends in Basic Test Battery scores—for each Naval Training 


and for all Centers combined. 


· Comparison of Code Aptitude Test (Thurstone) and Radio Code 


Aptitude Test—Speed of Response. 


а А 
у score patterns of graduates of certain Class 
schools. 


: . Я у ; s at 
. Analysis of test score qualifications of service school enrollee 


two Naval Training Centers. 


"n Š tion 
- The use of additive scores on the Basic Test Battery for selec 


purposes. 


- Determining the content of the Basic Test Battery. 


PREDICTION AND VALIDATION STUDIES 


А а 
aval Training Schools (Signalman ап 
Quartermaster), 


z А у «ће 
educational selection requirements for 
classification of enlisted personnel. 


Analysis of certain sele 
Development and vali 
strikers, 


ction requirements for acrial gunners. — 
dation of selection requirements for radar 


oe . гоп of 
-Verbal Classification Test in the selection 


Steward's Mates for submarine service, 
ter Scores of experienced gunners. 


Р - : heir 
alifications of enlisted personnel and d 
performance in the Fleet 


quirements for Advanced Service Schools. g 
he Navy Basic Test Battery at Naval Trai? 
s and Electrical Hydraulics). 


ic 
chool validity data on Forms 1 and 2 of Bas 
Test Battery, 


" he 
tes Navy Basic Test Battery in 09 
sted men in a Class B school, 
—Advanced). 

Disposal School. t 
of psychiatric screening devices for 
gue cases, 


OTHER STUDIES 
y Classification Project. 


: Я ап 
еп Selection Department recommendations 
assignment of recruits at the end of Recruit Training. 


selection and placement of enli 
Training School (Fire Control 
Prediction of success in Bomb 
Development and validation 


ће 
identification of combat fati 


SIO Oe 
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. Analysis of procedures for the selection of enlisted personnel for sub- 
marine service. 
- Estimated reliability of Specialist (C) Interviewers’ recommendations. 
- Analysis of causes of attrition in Radio School. 
· Analysis of quota system operations for Class A schools. 
- Study of attitudes of enlisted men at the Amphibious Training 
Center, Pacific Fleet (5 reports). 
Report No. 1. Fundamental Motivations. 
Report No. 2. Prestige of Amphibious Duty. 
Report No. 3. Attitude Toward Officers. 
Report No. 4. Job Satisfaction. 
Report No. 5. Opinion of Shore Training. 
- Navy Men Appraise Educational Services (a series of 9 reports on the 
results of Information Survey 2) 
Report No. 1. Getting the news of the day. 
Report No. 2. Interest in talks and discussions about the war. 
Report No. 3. Newsmaps. 
Report No. 4. Appraisal of the Navy's role in keeping men up-to- 
date on the news. 
Report No. 5. Participation in USAFI. 
Report No. 6. Participation in off-duty classes. 
€port No. 7. Post-war educational plans. 
€port No. 8. Accreditation services. 
€port No. 9. Interest in war orientation readings. 


APPENDIX C-2 


TO I Г E. Y Tq -106, 
2215 i NDRC PROJEC N : 

PICAL LIS OF RESEARCHES B 1 s : > 

COLLEGE ENTRANCE EXAMINATION BOARD ON THE NAP y's 


9. 


10. 


l'These researches were conducted in col 
tion, Bureau of Naval Personnel. The titl 
published by the Bureau of Naval Personn 


- Averages, standard deviations, and int 
. Factor analysis of the 
. Item analysis of Nav. 
- Validity of Navy Aptitude Tests in 


- Statistical analysis of the Mechanic 


. Selection of items for the U.S. N 


APTITUDE TESTING PROGRAM ! 


Officer Personnel 


DEVELOPMENT AND VALIDATION OF APTITUDE TESTS 


ciao t— 
. Preparation of the United States Navy Officer Qualification Tes 


Form 1. OSRD Report No. 1273. March 12, 1943. 


d 
. Analysis of the N.R.O.T.C. Selective Examination (Form C) an 


15, 
suggestions for its revision. OSRD Report No. 1290. February 
1943. 


Я li- 
- Development and validity of the United States Navy Officer Qua 


fication Test. OSRD Report No. 3186. January 7, 1944. 


5 ifica- 
+ A statistical evaluation of the United States Navy Officer Quali 


44. 
tion Test—Forms 2 and 3. OSRD Report No. 3978. August 4, 19 
Enlisted Personnel 


DEVELOPMENT AND VALIDATION OF APTITUDE TESTS 


ing 
` Naval Aptitude Tests: A. Reliability; B. Scoring Accuracy; С. Sco! 


Procedures. OSRD Report No. 1127. December 10, 1942. rude 


ercorrelations of Navy APU 
Tests. OSRD Report No. 1536. June 7, 1943. 


ification 
New United States Navy Basic Classificat 
eport No. 3004. September 29, 1943. 3089. 
у Aptitude Tests. OSRD Report No. 


Test Battery. OSRD R 


December 30, 1943. 


T 
, . аке 
service schools at the Great L 44. 


port No. 3245, January 31, ! 


Naval Training Station. OSRD Re еро" 
al Knowledge Test. OSRD R 


No. 3246. January 28, 1944. 


ance 

. Validity of an experimental battery of aptitude tests at the Ordnat 7 
and Gunnery Schools, Washington Navy Yard. OSRD Report 
3619. April 29, 1944, 


Form 2 and the U.S. Navy Tests 
soning—Form 2. OSRD Report No 
The construction and vadidatio 
Test. OSRD Report No. 4556. J 


sec 
h 
laboration with the Test and Rescate and 
es of tests constructed in this prog” 

el are listed in Appendix B. 
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* Predict 


* Selection 
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DEVELOPMENT OF IMPROVED MEASURES OF ACHIEVEMENT 


- Memorandum on service school grades. OSRD Report No. 3177. 


January 6, 1944. 


· The development of achievement tests for Gunner's Mates Schools. 


OSRD Report No. 5259. June 25, 1945. 


: Achievement examinations for Signalman School. OSRD Report No. 


5460. August 90, 1945. 


: Development of achievement tests for Clas A Naval Training 


Schools (Torpedomen). OSRD Report No. 5520. August 31, 1945. 


: Development of achievement tests for the Landing Craft School, 


Coronado, California. OSRD Report No. 5670. September 14, 1945. 


- The development of performance tests for use in Class A Electrical 


Schools. OSRD Report No. 5666. September 13, 1945. 


· The development of Radio Code Receiving Examinations. Project 


Memorandum Мо. 18. September 27, 1945. 


IMPROVEMENT OF RECORDS 


* A procedure for sorting the Enlisted Personnel Qualifications Cards. 


OSRD Report No. 4689. January 22, 1945. 


* Classification data available to ships' officers. OSRD Report No. 5145. 


May 30, 1945. 

n experimental personnel record system for shipboard use. OSRD 
€port No. 5303. July 8, 1945. (Prepared in collaboration with the 
Enlisted Classification Section and the Test and Research Section, 
Bureau of Naval Personnel.) 


SELECTION AND CLASSIFICATION PROCEDURES 


| An evaluation of the Personal Inventory for predicting success in 


arachute School. OSRD Report No. 4870. March 28, 1945. 


` <n evaluation of the Personal Inventory and certain other measures 


3 the prediction of submarine officers’ evaluations of enlisted men. 

Report No. 5557. September 7, 1945. 

ing success in service school from the order of assignment. 
D Report No. 5556. September 7, 1945. 

€ use of test scores and Quality-Classification Ratings in predicting 


b cess in Electrician’s Mates School. OSRD Report No. 5667. Septem- 
er 13, 1945, 


Suc 


GENERAL METHODOLOGICAL REPORTS 
appli: of test items by correlation with an external criterion, as 
pp led to the Mechanical Comprehension Test-OQT O-2. OSRD 
Pont No. 3187. January 8, 1944. : 
Aracteristics and uses of item-analysis data. OSRD Report No. 


4. 
. The UBust 19, 1944. 


Preparation of norms for the Fleet Edition of the General Classi- 

on Test. OSRD Report No. 4242. October 10, 1944. 

I) e tistical evaluation of the Basic Classification Test Battery (Form 
` D Report No. 4636. May 14, 1945. 


ficati 
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SAMPLE DIRECTIONS FOR ADMINISTERING 
A PERFORMANCE TEST 


GENERAL DESCRIPTION OF THE 2Ü MM. PERFORMANCE TEST 


І. Purpose. The purpose of this performance test is to measure the ability of i 
to perform certain tasks involved in the maintenance and operation of the 
gun. 

п. 


General procedure for administering. With nine guns and three se eo^ 
students may be tested at one time. About 25 minutes is required to = ae 
group of nine students. This includes the time needed for giving directions, с pd 
ing station, etc. Six runs would then be necessary to test a class of 50 students, La 
the total time would be about two hours and a half. Within this time a writ 
test and other tests may also be administered. 


The procedure for administering the performance test is as follows: 
Nine working stations for students are prepared. 


soper 
A. At three stations (Station A) students disassemble and assemble the trigg’ 


mechanism, the magazine interlock mechanism, and the double loading 

stop mechanism. are 
B. At three stations (Station B) the students, working at guns on mounts, edh 

required to remove and replace the barrel, remove and replace the bre 


face piece, cock and uncock the gun, and place a magazine on the gun 

and remove it. е ple 
C. At three other stations (Station C) the students are required to діѕаѕѕет 
and assemble the trigger casing group and the breechblock. 


Thus nine students may be tested at one time. 


One student and one proctor are placed at each of the nine stations. At a signal v^ 
the timekeeper, the proctor tells the student what to do, and at another signal nd 
students begin work. Each proctor observes the work of the student at his station E y 
marks a record form to indicate whether or not the specific operations were correc 
performed. 


H Б the 
When time is called, studen proctors get the gear in order PP in 


ts stop work and the 


is again put in order, students a 
three jobs. The test is scored in t 


PRELIMINARY ARRANGEMENTS 
І. Assemble all necessary 


" sag the 
materials. The materials needed for administerinE 
performance test for the 


20 mm. gun are as follows: 


1. Six 20 mm. guns on tables with shoulder rests and barrel springs removed 
2. Three 20 mm. guns on mounts. 
3. The necessary tools at each station. 
4. A supply of record sheets. A s 
At least one record sheet fo; 
graphed. 


= pooklet 
ample record sheet is included in this mime? 
т each student to be tested must be 


470 


п. 


ит, 


Iv, 


м, 


Vin, 


Vir, 


Sample Test Materials 471 


5. Copies of the Directions for Proctors. One copy of these directions is in- 
cluded in this booklet. Additional copies should be prepared so that each 
proctor may have a copy. А Я "Me 

6. Directions for administering the test. A copy of these directions is included 
in this booklet. 

7. Astop watch or a watch with a second-hand. 

8. A blackboard, chalk, and eraser. 

9. Pencils for the proctors. 


Conduct a training session for proctors. One instructor is needed to serve as time- 
keeper, give the general directions, and supervise the test. One proctor is needed 
to observe and record the performance of each of the nine students. It is prefer- 
able to use instructors as proctors; but if enough instructors are not available, 
Students in the last week of the Gunner's Mate course сап do a satisfactory job, 
Provided they are given adequate training. A training session of at least one hour 
should be conducted the day before the test is to be given. In training proctors 
it is necessary to give them instruction on the following points: 


l. Give them a review of the gun and make sure they can speedily perform the 
tasks which they are to proctor. . А 

2. Make sure that they understand the method of recording observations and 
time on the record sheets (see Directions for Proctors). 

3. Make sure that they understand that they are not to coach the students 

during the test; proctors are to aid students only when necessary to prevent 

à student from injuring himself or damaging the equipment. 


Arrange the equipment in such a way that the test can be administered efficiently. 

A suggested arrangement of equipment is shown in the accompanying diagram. 
lake sure that the guns are properly assembled at the beginning of the test. 'The 

Buns on mounts should be completely assembled. Those on tables should be com- 


pletely assembled except that the shoulder rests and the barrel springs are 
removed, 


DIRECTIONS FOR THE TIMEKEEPER 


Place one proctor at each gun. 
fake sure that each proctor has a pencil. 
R each proctor one record sheet. 
àtion one student at cach gun. 
Say: “WRITE YOUR NAME, CLASS NUMBER, AND BILLET NUMBER ON 
THE RECORD SHEET.” 
The Proctors should have the students fill in the blanks on the record sheet. 
hen the proctors place the record sheets conveniently for recording their 
observations, 


Say: “THE PROCTORS WILL TELL YOU WHAT TO DO. DO NOT START 
WORK UNTIL I SAY BEGIN. WORK CAREFULLY. IF YOU KNOW 
YOUR JOB YOU WILL HAVE PLENTY OF TIME. DO NOT HURRY. 
YOU GET NO CREDIT FOR EXTRA SPEED. PROCTORS, GIVE 

DIRECTIONS.” Wait 15 seconds, then say: “BEGIN. 

Immediately write 1 on the blackboard. After one-half minute erase the J and 

Write 2, After another half-minute erase the 2 and write 2, and so on. At the 

end of five minutes say: "STOP." Erase the 10 and write 11. 

Say: “PROCTORS, MAKE SURE THAT THE RECORD SHEETS ARE COR- 
RECTLY MARKED; THEN SIGN YOUR INITIALS.” Allow time for 
the proctors to check the record sheets; then say: “PROCTORS, GET 
YOUR GEAR IN ORDER. STUDENTS STAY AT YOUR STATION 
UNTIL TOLD TO MOVE.” 

When the gear is in order, say: “ТАКЕ YOUR RECORD SHEET AND GO 
TO THE NEXT STATION.” The proctors show the students where the 
Next station is located. . 

Then say: “PROCTORS, GIVE DIRECTIONS.” Wait 15 seconds and then say: 
“BEGIN.” 
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Proceed with steps VII to X, and repeat until each man has been at all three 
stations. 


XI. 
XIII. 


Collect the record sheets and send the students back to the classroom. 


Make sure the gear is in order for the next group of students. Repeat steps Ш 
to XII for each new group until the entire class has been tested. 


SSS > 


Blackboard 


Station B 
cO мм gun 


O^» mount 


лет ог B 
го MM gun 


от mount 


Saton) 8 


ог Mourn}, 


Suggested Arrangement Of Equipment for IAE 


2O MM Performance Jest 
"n rc 
XIV. It is necessary to check the work of the i ake $7. 
1 Proctors during the test to m! a 
they are not coaching the students and that they are cardine their obser" 

tions properly. 
XV. Collect the copies of Directions for Proctors before discharging the proctor: 
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DIRECTIONS FOR PROCTORS 


20 MM. PERFORMANCE TEST 


You аге to assist in administering a performance test to men studying the 20 mm. 
Bun. You have two responsibilities: 

l. Observe the performance of the student at your station and record it on his 
record sheet. 


Keep the gear in order at your station, 


Remember that you are helping to give a test. The student is on his own, and you 
mist not interfere or give aid of any kind unless he is about to injure himself or 
amage the equipment. 


I. At the beginning of the test you should have at your station: 


A. One 20 mm. gun. (At Station B, the gun must be on a mount.) 
B. The tools necessary to perform the job at your station. 


n. When the instructor gives the order, have the student fill in his name, class 
number and billet number. Then take back the record sheet and put it in a 
ш convenient position for marking. | А А . 
© When the instructor tells you to “give directions” tell the student his first job. 
For example, if you are at Station B, say: “REMOVE THE BARREL FROM 
THE GUN." 
If the student performs a job correctly, circle Yes after the job on the record 
Sheet; if not, circle No. When the student is finished with the first job, tell him 
to do the second, and so on. For each job, circle either Yes or No to indicate 
y Whether or not it was done correctly. 
* As soon as the student finishes the last job at your station, look up at the black- 
board and notice the number written there by the timekeeper. Copy this num- 
Der in the blank space under TIME at the right of the answer sheet. If the last 
VI. Job is not finished before the timekeeper says stop, write 77 in the blank space. 


Vhen directed to do so by the timekeeper, get the gear in order for the next 
Vir Student, 


When the timekeeper tells the students to go to the next station, give the 


Vin, ја his record sheet and tell him where his next station is. 
Ix €peat steps II to VII until all students have been tested. 
` semember to give no aid or advice to the student unless necessary to prevent 
mage or injury. 


Raw Navy 
RECORD SHEET Score Grade 
20 mm. PERFORMANCE TEST EN EN 
NAMr 
о ИН РИКИ CLASS. ..26 coss os BILLET NO....... 
STATION A TIME 
Proctor’ 1. Remove trigger plunger and spacer. l. Yes No 
Initials 2. Reassemble the trigger mechanism. 2. Yes No 
3. Remove magazine interlock carrier spring. 3. Yes No 
4. Reassemble magazine interlock mechanism. 4. Yes No 
Zz Remove the D. L. S. lever spring. 5. Yes No 


- Reassemble the D. L. S. mechanism. 6. Yes No 
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STATION B 
7. Remove the barrel from the gun. 7. Yes No 
8. Replace the barrel. 8. Yes No 
9. Remove the breech face piece. 9. Yes. No 
Proctor's 10. Replace the face piece. 10. Yes No 
Initials 11. Cock the gun. ll. Yes. No 
12. Uncock the gun. 12. Yes. No 
E Place a magazine on the gun. 13. Yes. No 
14. Remove the magazine from the gun. 14. Yes No ——— 
STATION C 
15. Remove parallelogram spring box. 15. Yes No 
16. Remove parallelogram. 16. Yes No 
17. Remove trigger hook & trigger hook holder. 17. Yes No 
Proctors 18. Reassemble the whole group. 18. Yes. No 
Initials 19. Remove hammer. 19. Yes. No 
20. Remove striker pin. 20. Yes No 
| E Remove breech face piece. 21. Yes No 
22. Reassemble the gun. 22. Yes No ——— 


1 ea 
L Other tests. The performance test is one of three tests which should be give? 


II. 


2575 
COORDINATION OF IDENTIFICATION, PERFORMANCE, AND WRITTEN Tes 


Total 
Number of No's crated] | Time 
3 x number of No's " | 


ch 


E denti" 
е an identification test and a written test. Tn test 
used is described in another booklet. The Wr! wed 3” 
should. be gue prepared by the school. Suggestions which should be enm using 
preparing the written test may be found in the tructing @ 
Achievement Tests—A Guide о син 


ћ for Navy Instruct 08). the 
It is possible to administer " Sans Loe 


week. The other two tests ar 
fication test which should be 


Navy Instr and ^r; 
j the identification test, the performance test» amin? 
written test to a class of 50 men in a period of less than three hours. All ex. ting 
tions may then be administered on : 


5 a 
i examinations is illustrated in the diag" 
procedure is as follows: == be 
1. Assemble the class in the room where the written examination 5 
administered. "md 
2. Divide the class into P-test hen 


groups, the size of each group being (16 e. 
of men to whom the peritum test can be мне) at one ne ust) 
3. Send the first P-test group (for example, the first ten men on the i 
to the room where the performance test is administered iic? 
4. Send the last 25 men on the muster list to the room where the iden" 
test is to be administered, 


to. js 
5. Start giving the written test t ini "Pay 
6. As soon as th f o the remaining men. is £^ pest 
€ performance test is completed by the first group» pitte, ue 

sent back to the classroom where they begin working on the Vor 0 | 
Then send the second P- ^ i 


e performance test room This procedure contin" J 
; ври ћауе been given the performance test P hey sno 
3 soon as t è ddentificiti E 
return to thi he 25 men have completed the identification test ie 
ae the classroom and begin work on the written test. mano дк 
Pproximately 45 minutes before it is anticipated that the рено? 10 
will be completed by all m 5 | 


t en 15167 
the identification test. » Send the first 25 men on the mu 
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нов pennant permits all the men to take all three tests within a period of three 

nue mud E conflict. Maximum use is made of the available testing time. It is neces- 

interrupted groups except the first апа last group taking the performance test be 

Sanie once in their written test; this is not a serious objection if the written 
ation is of the short-answer or objective type. 


2- 7257 Group 
Pd 1 Lit Le a 


Diagram Mustratimg the Method of Coordinating the 
Administration of Identification, Performance, ard 
Written Tests 


The a: 
© di 
the” зуе m assumes that 10 men can be tested at once on the performance test. 
he last Ра can be used just as easily with P-test groups of 8 or 9 men. In these cases, 
= in the ES Broup would contain fewer men than the other groups, if there are 50 
Ome Class, 
` с 
Мере 


est , ust be taken to prevent students from talking with each other about the 


items while going to and from the performance test. 
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SAMPLE DIRECTIONS FOR ADMINISTERING AN 
IDENTIFICATION TEST 


DESCRIPTION OF TORPEDO IDENTIFICATION TEST 


oes by 
Purpose: To judge the trainee's familiarity with Mark 13 and Mark 15 torped 
using a wide sampling of disassembled parts from both torpedoes in order 

(a) to test the trainee's ability to name the parts correctly, and 


2 tioning 
(b) to test his knowledge of how the parts function, or how improperly func 
parts should be adjusted or repaired. 


General Procedure: 
of names and a separ 
three feet apart alon 
path around the room, so that the se Я сапу with 
mimeographed answer blanks which they isor 

um- 

answers the item at his station by writing Р адка ће 

indicate the correct name and опе to ње ари 

correct function (ог adjustment). The instructor then says, “Move,” and сас edo part 
cutively numbered station, where he examines the torp! 


has had ? 
» as before. The procedure continues until each man 
chance to answer all of the test items. 


It is possible to test simultaneously as man 
test. With Forms C or D te 
, 35 men can be tested in one hour, If only 30 men were tes 
35-item test, the time i 


any given time. If lar, 
be used to test several 


groups of trainees. t 
The advantages of this testing method over written or pictorial tests are tha 


to aid iP 
and manipulate it, to aid recognition OF 
figuring out the function or adj 


Security of Tests: The test su 
are not in use. After the materi 
the time of the test. I. 
but should not reveal 


ey 
ile thi 3 
pervisor should keep all materials in a locker WP! atil 


H H e 

al is laid out for a test, the room should be — хрес“ 
nstructors may tell students what types of examinations 

the content of specific test items, 


PRELIMINARY ARRANGEMENTS FOR THE IDENTIFICATION TEST 


І. Assemble all necessary materials for one form of the test; these include: 


ist 0: 
Td bears a list of part names and a m in 
with transparent covers, are suppli xample 
n of the Bureau of Naval Personnel (€ 


f 512 


ID є 
A set of torpedo parts. The part-list for each of the four forms of the pam 
is included in this booklet (on 


~ P t 
shown here). Each list gives 


ngly numbered card. i 
not be taken from servi 
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: Answer sheets. A sample answer sheet, usable for any form of the ID Test, is 
a аа below. A large supply of these may be mimeographed and kept on 
and. 

A supply of extra pencils for students who lack pencils or pens. 

A clock or watch with a second-hand. 

Arrange to have trained personnel available for administering the test. One in- 
Structor is needed to supervise the test, and it is well to have one or two other 
Instructors who are familiar with the test procedure to assist in proctoring, 
specially at the beginning of the test. 

Lay out the test materials an hour before the test is given. 

Arrange tables in the testing room to form a fairly continuous route around the 
room. Plan on at least three feet of table space for each test item. In a large 
Toom a rectangle of tables may suffice. Or a variation such as shown in Figure A, 
Will care for a 35-item test in an ordinary room. This permits the proctors to 
Stand inside the enclosure and observe the students, who are working around the 
Outside of the table enclosure. 

For a 49-item test, if space is limited, it may be necessary to have students work 
9n both sides of the tables, and to arrange the tables in some form such as 
illustrated in Figure B. 

Lay out the ID Test cards on the tables. The cards should be at least three feet 
драп, and cards from the first half of the test are alternated with cards from the 
ast half of the test, as illustrated in Figure A or B. Thus consecutive numbers are 
Wo stations apart, so that a student can not easily see the item he last completed 
or the next item to which he will move. The students move two stations to the 
right each time. Thus, to respond to all items, а student must make two complete 
rounds of the tables, | А 
a ау each torpedo part on the upper half of the corresponding card. pre one 
away) blank under the edge of each card (to prevent the blanks from blowing 


Prepare 


п. 


Iit, 


Тү, 
enti @ scoring key and check the materials. An instructor should take the 
Ure test, marking his answers with red pencil on a regular answer blank. Check 
“se answers against the list of correct answers for whichever form of the test is 
err’ Used. This is a check that each part is placed on ede је Een 
D i eet marked in red is 
kep, > CAN be corrected before the test begins. The answer 5 


ept 
Pt for use as a scoring key. 


5 ADMINISTERING THE TEST 


tatio; " 
Hoj? Опе man ide pencils for men who do not have pencils. 
rik ee а point to top line and say: 


чуур, ап answer sheet where all men can see it, 
ER IN THE 
SPALTE YOUR NAME, CLASS NUMBER, AND BILLET NUMB 


NUMBER IN THE UPPER LEFT- 


ORNER. FIND THE CORRESPONDING CARD NUMBER ON YOUR 
M. Ree SHEET AND CIRCLE IT, TO SHOW YOU WHERE TO BEGIN 

NG YOUR ANSWERS.” (pause) 
EACH CARD IS A TORPEDO PART. YOU MAY PICK IT UP AND 
E IT IF YOU WISH. BELOW IT ON THE CARD IS A LIST OF 


2 О T. SELECT THE CORRECT NAME, 
NOTICE МЕ OF WHICH I$ CORREC IT, AND WRITE THIS NUMBER 


IN THp ТНЕ NUMBER IN FRONT OF 
HE ‘NAME G THE CARD NUMBER THAT YOU 
CIRC pp NAME" BLANK FOLLOWIN G d point to the ‘Name’ column) "DO 


THs -" (Hold up an answer shee 
Ww Now.” (Allow about one-half minute.) 

lTEMs PAD THE LIST OF FUNCTIONS ON 
ANY Casp ER TO ADJUSTME 
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Class... esse Billet ‘Nowe из sees Name 


TORPEDO IDENTIFICATION TEST Score NEN 


IN THE FIRST SPACE AFTER THE CARD NUMBER, WRITE IN THE NUM. 
BER CORRESPONDING TO THE CORRECT NAME OF THE PART. IN TH 


SECOND SPACE, WRITE IN THE NUMBER CORRESPONDING TO THE FUNC- 
TION THAT SEEMS TO YOU MOST CORRECT. 


Card No. Name Function 


Card No. Name Function 

1 26 = 
2 27 m 
3 = 28 —Ó 
4 — а 29 — 
5 — 30 a 
6 ——— — 31 ——9 
7  — ааа 32 ——— 
5 — — 33 aes 
Se 34 —À 
10 — M ERN 35 — 
11 пне et 36 — 
12 — E 37 "-———— 
13 ЦРН — 98 ae 
14 а= EE 39 — 
15 еза n 2 40 SS. 
16 € — а= 41 ae 
L7 —— E 42 nme 
18 NEN == 43 nm 
19 — Ve а 44 ве 
20 — СА 3k — 
21 — —À T €— 
22 ЛИ —— 4 np 
23 ete ЧИН "m -— 
a SS а. 49 = 

о __ 


Sample Answer Sheet 
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PART AT YOUR STATION, AND WRITE THE NUMBER OF THAT 
STATEMENT IN THE SECOND BLANK FOLLOWING THE CARD NUM- 
BER. DO THIS NOW.” 

Allow two or three minutes while the proctors check to make sure that the students 


are recording answers in the correct spaces. Do not tell a student whether or not his 
answer is correct. Then say: 


"NOW you SHOULD HAVE WRITTEN A NUMBER IN EACH OF THE 
SPACES FOLLOWING THE CARD NUMBER THAT IS CIRCLED ON YOUR 
ANSWER SHEET. YOU ARE TO PUT A NUMBER IN EVERY BLANK AS 
YOU CONTINUE THE TEST. IF YOU AREN'T SURE, MAKE THE BEST 
GUESS YoU CAN.” vati 
"YOU ARE TO TAKE THE ANSWER SHEET WITH YOU WHEN У 
MOVE, BUT Lu Ue TORPEDO PART ON THE CARD WHERE YOU 
FOUND IT. WHEN I TELL YOU TO MOVE YOU WILL GO TWO STA- 
TIONS TO YOUR RIGHT TO FIND THE NEXT CONSECUTIVELY NUM- 
BERED CARD. DECIDE ON THE NAME AND FUNCTION OF THE PART 
T THAT STATION, AND BE SURE TO WRITE YOUR ANSWERS IN THE 
SPACES AFTER THE NUMBER OF THE CARD AT WHICH YOU ARE 
WORKING. YOU ARE NOT TO CIRCLE ANY MORE CARD NUMBERS. DO 
You UNDERSTAND THE DIRECTIONS?" 
Answer ?ny questions. 


"AFTER YOU FINISH WITH EACH CARD, TURN YOUR ANSWER SHEET 
FACE DOWN AND WAIT UNTIL YOU ARE TOLD TO MOVE. NOW MOVE 
IO THE SECOND STATION TO YOUR RIGHT AND BEGIN WORK 
IMMEDIATELY." 
interval. i p“ ЈЕ" il the men have completed the test. 
This: als of 114 minutes say, "MOVE," unti | 
пи interval тау и to be the speed of the students, in order not to rush them 
т У, but до not bore them with waiting for a very slow man. | е " 
Studen Proctors should continue to move about the tables to make ane E ele ^ 
cheating. are recording answers in the proper places, and to detect or discourag, 
Ted the eng Of the test, collect the answer sheets and send the students back to their 
Whe Oom, If another group is to be tested, check to see that all material is in order. 
"nti a Broups have been tested, collect the materials and secure them in a locker 
Plan СУ аге to be used again. А 
ay be © use a different ja of the Identification Test on the next class. The forms 
interchangeably, in random order. 
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+ 
Figure А. SAMPLE ARRANGEMENT FOR 35-ITEM ID TES 


ARDS 
(+ test SUPERVISOR; (B). PROCTOR; NUMBERS - ID TEST С 


Figure B. SAMPLE ARRANGEMENT FOR 


Е5 
49 -1ТЕМ 10 T 
(3): TEST supervisor, ©: Proctor; 


NUMBERS = 1D TEST 
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TORPEDO IDENTIFICATION TEST, FORM А 


Correct Answer 


Torpedo Part Мате Function 
l. Stop valve and carrier 5 * 
2. Piston fork ! 3 
3. Centering pin, spinning mechanism 4 3 
*. Stop valve plug and spindle, Mk. 13 4 1 
5. Delivery check valve guide 3 4 
6. Upper oiling bolt, Mk. 15 ! » 
7. Depth engine valve 1 2 
8. Starting piston body 4 " 
9. Mid-bearing outer race, Mk. 15 2 3 
10. Arming screw 3 4 
П. Oil pump shaft, Mk. 15 1 5 
12. Left pallet pawl 1 1 
13. Crosshead bushing, Mk. 15 3 1 
l4. Air release mechanism spring 5 5 
15. Delivery check valve 2 4 
16. Four-part spindle bushing, Mk. 13 3 4 
17. Air strainer (short) 2 4 
18. Spring bell crank 4 5 
19, Stop valve plug and spindle, Mk. 15 4 4 
20. Exploder worm wheel 3 d 
21. Self-aligning bearing гасе, Mk. 15 4 2 

22. Reducing valve, Mk. 15 8 : 
23. Oil pump connecting rod, Mk. 15 3 = 
24. Vertical steering engine 2 4 
25. Main drive gear bushing, Mk. 15 2 1 
26. Valve bell crank 3 l 
27. Exploder worm wheel 4 8 
28. Charging valve bushing = | 
29. Unlocking rack 2 : 
90. Gyro wheel bearing, locking end 2 4 
31. Air check valve guide plug 4 1 
32. Top commercial bearing, Mk. 15 2 4 
33. Charging check valve 8 3 
31. Valve connection rod, Mk. 15 4 5 
35. Pendulum tool, 414A 2 4 


SCORING THE TEST 


© Scoring key prepared before the test on a regular answer sheet has the correct 
TS Wri У Е 
по Чеп in red pencil, " " : 
foldeq he Scoring key along the right-hand edge of the first "Name" column; place the 
Pare Саве next to the “Name” column of the paper which is to be scored; and com- 
Stude € answers, Make a heavy red pencil mark through every wrong answer on the 
5 Paper. An omission counts as an error. " -— 
this Е the Scoring key along the right-hand side of the first Function’ column; place 
ава У: Са edge next to the corresponding column of the paper being scored; and 
im Pare answers, Mark errors and ommissions with a red pencil. . 
the « old the scoring key along the right-hand side of the Name column and 
Co unction” column for cards 26 to 49, and score these columns in the same way. 
Shea, at the total number of red error marks in all four columns of a student’s answer 
Ans, Утас this number from the possible perfect score to get the number of correct 
ame E. Dter this number of correct answers in the score box under the student's 
Wh © top of the sheet. 
be Gn these Scores are recorded in the class book or in the office records they should 
“ted to Navy Grades. 
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N 
SELECTION OF ITEMS FOR THE OFFICER QUALIFICATIO 
TEST, FORMS 1, 2, 3 


The first step in the development of the tests was to devise an ке 523 
mental form which contained an excess of items over the number nee the 
On the basis of item analyses, those items which failed to conform to seat 
criteria adopted for inclusion in the tests could be discarded. The ex á 
analyses made possible an examination of faulty items with a view 
revision intended to eliminate the flaws in these items. sca. ithe 

Two experimental versions of the Officer Qualification Test aa 
administered, one to a sample of officer candidates, and the other c basis 
Broups of indoctrinees. Item analyses were then performed. On the cee 
of the first of these the items of Officer Qualification Test—Form 1 W 


e - Forms 
selected, and from the second analysis items were chosen for Form 
and 8. 


HICH 
ITEM AND THE SUBTEST IN W 


рават ich а 
Тыв» indicates the degree to з a 
the subtest. The biserial coelfici 


5 1 

with the subtest score, "relate positively and as high as po? of 
Irem Dirricurrv, The Statistic used as an index of the difficulty ed 

an item was the proportion, Р, of those attempting an item who answ 

1t correctly, While this proportion shows the case of the item rather ting 

the difficulty, which would be 1—, the arithmetical work of subtrac ple 
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The criteria adopted for the selection of items for any of the three 
forms of the Officer Qualification Test depended on the distributions of 
P and па, for the items in the experimental forms, and on the excess of 
items, which determined the number which could be discarded. The gen- 
eral procedure followed was to discard as many as possible of the items 
of low biserial correlation. The exact minimal value of acceptable ry, 
depended in each case on the number of items which could be discarded 
and on the distribution of values of ry. 


Significance of Changes in Difficulty and Biserial Correlation of Items 


When the difficulty (p) of an item and the biserial correlation (7,,,) of 
an item with its subtest were evaluated on two samples and tests were 
made to determine whether the item differed in either respect on the two 
administrations, the following criteria were adopted: 
IFFICULTY. In order to test the significance of a discrepancy in the 
ар of an item, the chi square test was used. The degree of significance 
h ge arepancy in p as measured by chi square depends on three factors. 
ee factor is the magnitude of the discrepancy. The second factor is 
Whi oe of cases. As N becomes smaller, the minimum p discrepancy 
hein 15 significant increases. Ihe third factor is the difficulty level of 
= ‘tem. The further the value of p is from .50, the smaller is the minimum 
api eee which is significant. This effect is most marked from .10 to .00 
" es -90 to 1.00, but is also noticeable from .10 to 20 апі from .80 
Bn уд: tween .20 and -80 the level of difficulty has relatively little effect 
A di Significance of a discrepancy. . . 
fud eq erence in p-value for the two administrations of an item was 
difa to be significant when the chi square test indicated that such a 
al nce would be expected to occur by chance in less than one out of 
теа times. 
crepa SUBTEST CORRELATION. In order to test the significance of a dis- 
the sa cy between values of Tois Obtained from two administrations ôf 
lated ^ item, the ratio of the discrepancy to its standard error was сај- 
to these While it would be desirable to apply a test of the null hypothesis 
зе values of у, there is no precise test of this hypothesis available 
used in difference between biserial correlation coefficients. The method 
number the present studies is probably a fair approximation when the 
the Реј cases is large (N = 500). A difficulty is that in the estimate of 
ard error the assumption of a normal distribution of 7,,, is more 
5 erroneous, 


~ wae mula used in the estimation of the significance of a change in 


: М Тыв, — Тыв 
Significant Кайо = n o 
Where: (fois, E Tos) 


с = o? == 
(Totis, — Тыв,) Tots, Tots, 
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- — E Е E. 
In these formulae, subscript 1 denotes a statistic for the first group x 
subscript 2 denotes a statistic for the second group. The standard erro 
of тъ, was calculated by the following formula: 


EZ] — rhy. 
2 


с = —_— 
Тыв VN 

where: 

Ty, = the biserial coefficient of correlation. 


Р = proportion of persons answering the item correctly (based 
on N,). 


9 = 5 P- 
z — the ordinate of the normal distribution curve correspond- 


ing to areas p and q under the curve. 
N — the total number of cases. 
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DIRECTIONS FOR CONVERSION OF RAW SCORES ON ACHIEVE- 
MENT TESTS TO GRADES IN THE NAVY 0-99 POINT SCALE 


All elementary enlisted schools were directed during the war to assign 
grades on a scale which ranges from 0 to 99, with 63 as the lowest passing 
grade. Since the total possible raw score varied from test to test some con- 
venient means was needed for converting raw scores to the Navy grading | 
system. Likewise, some means was needed for converting total points 
сагпед by a trainee into a final course grade. Instructions issued to school 
staffs for making this conversion are described below.! The standardized 
Achievement examinations constructed by the Test and Research Section 
Were provided with the necessary conversion tables before they were dis- 
tributed for use by the schools. 

Pe First make a distribution showing the frequency with which the 
pra Scores on the test occur. To do this, make a column of numbers 
ging from 0 to the maximum score which can be obtained. This in- 
dudes ај the possible scores on the test. Then go through the test papers 
oie pum a tally mark opposite the number corresponding to each score 
не Was obtained. These marks indicate the number of times each pos- 
€ score actually occurred. 
laime iie what Navy grade should correspond to the best score ob- 
tot a ar the test. This is a matter of judgment on the part of the instruc- 
Obtain should be based on the frequency with which high scores are 
ten the instructor's judgment of the difficulty of the test, and the 
étage of achievement required. A paper with no errors need not 
Sarily be given a Navy grade of 99; it might be judged to be worth 

Or even less, It must be remembered, however, that the range of final 
tg obtained by averaging several different tests will be less than the 
fa. Obtained on any one test. The reason for this is that it is unlikely 
also a man who makes an extremely high or low grade on one test will 

make extremely high or low grades on all of the others. Therefore 
avy grade assigned to the best student on a single test must be 
T than the highest grade desired on the final average grade. 

*cide what score on the test should correspond with a just-passing 
.Srade (63). This again is a matter of judgment. The instructor must 
i: nto account the frequency distribution which has been obtained, 
the Proportion of students expected to fail, the difficulty of the test, and 
the one of attainment required. Again it must be remembered that 
test. à of averaged grades will be less than the range of grades on one 
Cho; 1егеѓоге the score corresponding to a Navy grade of 63 must be 
i 11 such a way that more students will fail the particular test than 


tis dees 
i “sired to have fail on the final average. 


logos materia] is adapted from Constructing and Using Achievement Tests, Navpers 
Ureau of Naval Personnel, 1944. 
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4. Prepare a translation graph. The preparation of such graph is illus- 
trated in the accompanying diagram. The following steps should be car- 
ried out in constructing a graph for translating raw scores into Navy 


grades: 


а. On a piece of graph paper, place numbers from 0 to 99 along a line 
drawn at the bottom of the graph. Use one unit on the graph paper 
to represent one point on the Navy scale of grades. 

b. On a vertical line drawn through the 0 on the base line, place the 
full range of raw scores which may be obtained on the test. Let each 
unit on the graph paper represent one score point. (If the number 
of raw score points is large, it may be necessary to let each unit on 
the graph represent two raw score points; if the total possible raw 
Score is small, one raw score point may be represented by several 
Spaces on the graph.) Make a raw score of 0 coincide with the 0 on 
the base line, and put the highest raw score obtainable at the top. 

c. Make a dot on the graph which represents the intersection of à 
horizontal line extended from the highest raw score obtained in the 
test and a vertical line extended from the Navy grade which has 
been judged to be the equivalent of the highest score. This is point 
A on the graph—65 being the highest raw score in the test and 99 
being judged its Navy grade equivalent. 

d. Make a dot on the Braph which represents the intersection of à 
horizontal line extended from the lowest raw score obtained in the 

assing quality and a vertical line extended from 

3. This is point B on the graph—25 being the 

lowest raw score judged to be of passing quality and 63 being the 


пива in both directions to the edges of the graph. 
This is the “translation line.” " 


procedure, (Figure LE2) In Example A, a hort 
ntersects the translation li? 


74 (Point H). 
6. Set up a permanent tra 
it will, of course, be necessa; 


This may be considered a permanent translation graph and should 
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used for subsequent classes. However, if for any reason the general level 
of achievement of the students changes as indicated by scores on the test, 
it may be necessary to make a new translation graph, basing it on a fre- 
quency distribution obtained from a new sample of at least 200 students. 
For example, if all students consistently obtain Navy grades above 75 for 
à period of several weeks, it will be necessary to make a new translation 
Staph; if this is not done the Navy grades assigned will be seriously re- 
Stricted in range. 
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CONSTRUCTION AND USE OF ABACS 


Abacs are a type of computing diagram designed to decrease the labor 
involved in statistical analysis. These devices have been found ty be +. 
ful in expediting some of the statistical work involved in the Navy 
search program. . — 

"There are four basic diagrams in abac methods. In cach case one ily 
with a horizontal and a vertical scale and the appropriate — => 
and vertically lined grid for these scales. Then, upon this grid are sup 
imposed diagonal lines or radial lines. 

I. The graph for subtra 
from lower left to upper r 


-awn 
on this diagonal, the value x—y=0. Similarly a diagonal can be dra 


= l for any point on the diagonal, etc. 
After labelling the 


the abac with x and 


я rom 
II. The graph for addition is composed of diagonal lines running f со“ 


€ graph on the y scale one follows the pri 
he appropriate rac 14 e ds 
ne to the x scale pH ip 
Chart B of abac 4. ic. У 

IV. The graph in III could also be used for multiplication е n 
X — y/N, then y — xN. Bye 


; unl od 
1 у= ntering the graph on the x scale, 191 Jie 
up to the radial line (N) and across to npa scale, one has mu ip 


x by N to get the value of Y. An example of a multiplication diagra™ een 
be seen in Chart C of abac 7 (test of significance of difference 
two proportions). 

There are several devices which may be utilized to make Фе 
diagrams of abac methods more useful. 

It is frequently possible to set th 
parameter and then label the scal 


pasit 
a 


23:06 
io” pis 
е scale up in terms of a func!^ rh 


` е5. 
€ In terms of parameter valu 
488 
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eliminates the necessity of computing the value of the function of the 
parameter for each computation that is made after the original scale has 
been established. A good example of this is to be found in the formula 
for the standard error of biserial r. 


с | 
Tots VN 


The М Ра is a function of p. Therefore it is possible in an abac to соп- 


struct a scale on the basis of the function М.Р, but to label the scale 


z 
tr the appropriate p-values. Then when using the abac one enters 
With the p-value and the scaling of the abac automatically takes care of 


with 


the calculation of the function УРА. 


In the previous discussion we have mentioned only the use of each of 
the four basic diagrams as a discrete unit. It is frequently necessary to 
combine in sequence two or more of the basic charts in order to secure a 
*atisfactory abac. Examples of this are to be seen in abacs 3, 4, and 7. 

Р hen more than one chart is involved in an abac, it is desirable to use 
а “continuous line” method to speed up graphic computing. This method 
59181815 of placing one chart beside another in an abac so that the answer 
Scale in the first chart also serves as the scale by which one enters the 
Second chart, Under these conditions one does not read the value off the 
I Wer scale in the first chart, but instead continues to follow the original 
he from the first chart into the second chart. An example of rion be 
ist In the transition from Chart А to Chart B іп abac 4. de e sech 
foll no scale is indicated between the two charts, but istea one simp y 

©Ws a "continuous line" from one chart to the other. If the two charts 


№ : ; 
сте Separate, it would be necessary to read off a scale value when coming 


«at Of Chart A and then enter Chart B with this scale value. Thus, the 


К tinuous line" method avoids time consuming reference to -— 

t ates and eliminates the possibility of error 1n transferring from one scale 

? another, 

con "Se of space limitations it is frequently desirable to erpai oe 

Ntract à Scale when going from one chart to another. This is easily done 

S running an appropriate diagonal across the first of the two charts. See 
ta Ple in Chart A of abac 4. : : А TT 
-n Order to have a scale cover a sufficiently wide range for general u 
15 so s one end to an undesirable extent. 


It a | Пе тез necessary to compres 1 
the igh degree of ee in the computation of values for that end of 
5 Scal n ђе set up which covers the same 


€ is neces econd scale ca 
15а вагу» 28 e f only that end 
of nce on the chart as the original scale, but makes use o y 


* scale which had been undesirably compressed. This technique = 
carried Out to the number of scales that the person constructing the 


ab, А 
ас chart considers desirable and efficient. 
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For the construction of abacs, the use of a “standard cross-section en- 
graving 300 mm.” paper approximately 18” x 22” is recommended for 
generally satisfactory results. . 

In addition to the four basic diagrams of abac methods, other special 
abac diagrams may be found useful. Two special diagrams have been used 
in the abacs presented here. 

Abac 6 is an example of the use of one such special diagram. In this abac 
the diagram is based on the fact that for a point located on the perimeter 
of a circle the sum of the Squares of the coordinates for this point is equal 
to the square of the radius of the circle (Le, ту = ху + уу, where “i 


refers to the particular circle and “J” refers to a designated co-ordinate 
point on the perimeter of this circle). 


Another special diagram has been used to compute the value of a 


weighted average, according to the formula Ba офу 2. This 
N i T N 2 " 
equation can be stated in another form as follows: => Ps = bi ai The 
1 


ratios of the corresponding sides of similar triangles are equal; therefore 
the preceding equation can be expressed graphically by similar triangles. 
Let (P — Ро) and N, be sides of one triangle, and let (p, — P) and N, be 
corresponding sides of the other triangle, with the P scale being the com 
mon base line between the similar triangles (see Chart A in abac 7) Then 
one can read off the value of the weighted average at the point of contact 
of the two triangles on the P scale. i 


In " 
es е rw abacs have been found to have the following advan 
= == CR ar computing methods. Using ordinary office personne’ 

е faster t to large errors in operation, and requ" 


in favor of the abac ат ез 
еге an experienced mach! 
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should be excellent for facilitating the proper orientation of the student 
toward the statistical tools which are at his disposal. 

On the following pages are presented schematic drawings of specific 
abacs and a discussion of each. Due to space limitations, these sketches 
9 not show the detail and precision which make abacs accurate and 
efficient to use. Also, in some cases only part of the scale for a variable is 
Shown, while the actual abac presents the entire scale. If more complete 
Information concerning the construction of a specific abac is desired, it 
15 suggested that inquiries be made of the Research Department, College 
ntrance Examination Board, Princeton, New Jersey. 


Abac 1 


^BAC TO DETERMINE SIGNIFICANCE OF DIFFERENCE BETWEEN TWO INDEPEND- 
ENT PRODUCT-MOMENT CORRELATION COEFFICIENTS (N ASSUMED LARGE) 


This abac for testing the significance of difference between two in- 
*pendent product-moment correlation coefficients (А assumed large), is 


а 
Sed upon the formula: 
Ma. i x D S 
I. Difference ratio — 5 , 
т — 7; 
2 
| (55 
where c — 2 
1 2 x N/2 


ud Convenience in constructing and using the abac, formula I was 


Stormed to the following: 


(difference ratio)? [4 — (r, + 737] 


П. (n— 9 = 9N 


a? formula ap dei pcs ела ра ee Oe take correla- 
this Ое сіепі (r, — r,) must be to be significant at the desired level (in 
табо ase the 107 level). One enters the formula with the desired difference 
of (at the 1% level of significance, difference ratio = 2.57582), the sum 
е Correlation coefficients (5 dE tj) the number of cases (№), апа 
Cog 0165 the value of (r, — r,)?. The abac was constructed to avoid the 
dig Puting labor which is involved in determining the significance of 
e О between correlation coefficients. Data required to use the abac 
та» and N. А 
9 illustrate the use of the abac the following example is presented: 
њене the experimentally obtained values r: = 75, T: = 50, №, = 200, and N, = 200, 
h an dra 25, n + 7, = 1.25, and № = 200. One enters the т, + r, scale at the value 
line "s follows the vertical coordinate line to the point of intersection with the radial 
Scale == 200, Then follow the horizontal coordinate line from this point to the 7, — ү 
Since пе Td the scale value. For the example given, this value is slightly less than .20. 
Value ( ` Experimentally obtained т, — r: value (25) is larger than the indicated scale 


“хр; o) the : i P is significant at the 1%, level. If the 
er experimentally obtained value is sign % 
mentally obtained eene had been smaller than tbe indicated scale value, the 
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experimentally obtained difference would not be significant at the 1% level. er 
assuming that the abac has been constructed to test the significance of differences S ital 
1% level, as was true in the present case. By using sets of differently colored r: 
lines, several levels of significance can be indicated on the same abac. 


In the example presented above, we have dealt with the special T 
where the number of persons in each group is the same (N, = N.) nn 
N = N, = N, Actually, N is a composite value and for the more general 
problem where the number of persons is different for the two groups, thi 
composite N should be calculated by the following formula: * 


2N,N. 
N = 2—12. 
N, + N, 
Since N is assumed large, the composite N is computed as the rumie 
of cases rather than the number of degrees of freedom. For computat, 
by abac methods refer to Chart B in abac 7. In the present use of Char 
B, the value computed is 3 + FS which equals Es However, by appro 
priate scaling of line “р” in Chart B, one could read off the value of the 
composite N from this line. 


а 1 
Pig calculation of the composite N does not change the manner in which арас 
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f difference of independent correlations, 


Aba 
© 1. Abac for significance o 
assuming N to be large. 
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Abac 2 А 
INDE- 
ABAC FOR TESTING THE SIGNIFICANCE OF DIFFERENCE BETWEEN nm a m 
PENDENT PRODUCT-MOMENT CORRELATION COEFFICIENTS ACCORD 
FISHER'S Z-TECHNIQUE 
Abac 2 is based upon the formula: 


Diff. ratio — ъ=. 
Vata 
Let N, represent number of cases in first group, 


group, 
then n, = N, — 3, and п, =N, — 3. 


2 d to 
=N, = Му the formula was transforme 
the following working formula: 


и 26 

For example, if one had obtained experimentally the following values 1% co jd 
а= d es nm Cases in each Broup (N, = 1000 and N, = 1000); then aa 
enter the abac with the lar izontal scale, with 
ма pmi. ) on the horizontal sca 
these two values. It can b 


T, or Tj 


*00 +.25 +.50 +.60 *.70 4.75 


ry or T3 


Ab А -— ; 5 

де ас 2. Ађас for testing the significance of difference between two in- 

Pendent product-moment correlation coefficients, according to Fisher's 
z-technique. 
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Abac 3 


=F ЈЕМТ 
ABAC FOR CALCULATION OF THE BISERIAL CORRELATION COEFFIC 


i ion of 
This abac is based upon the following formula for the calculatio 
the biserial correlation coefficient: 


М,—М, (p 
se mJ 


Data required to use the abac are: the mean subtest score of the Е 
getting the item correct (M,); the mean subtest score of the Lyr] iet at 
taking subtest (M,); the standard deviation of the distribution of su ae 
scores for entire group taking the subtest (с:); and the proportior 
persons attempting the item who get the correct answer (p). 


Given the experimentally obtained values M,—M,—5, а = 20, 
and p = .30, enter Chart A on the M. — М, scale at 5, run up the 
vertical line to the radial line for с, = 20, across to the radial line 
b = 30 (in Chart B) and up to the zy, scale, which gives an answer 
of approximately .21. On a properly constructed abac, the тъ, value 
could be accurately computed to three places. 
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Abac 4 


АВАС FOR ESTIMATING STANDARD ERROR OF THE BISERIAL 
CORRELATION COEFFICIENT 


The formula upon which this abac is based is 


У и — "ы, 
DL о. 

Tota VN 
Data required to use the abac are the difficulty of the item (p), ge 
correlation coefficient (r), and the number of cases (№). In the abac 


Chart A is the subtraction, V 4 
z 


— ri. Chart B is the division of this 
quantity by the y N. 
Given the experimental 


and N — 200, one determi 
p=.10 апа s, 


y obtained values of p—.10, пи = 50, 


nes in Chart A the coordinate point for 
= 50. Then follow the diagonal line to line d, 
from there follow the horizontal line to the intersection with the 


radial line, N = 200. From the intersection follow the vertical line 

to the 9, Scale and read off the value. In this case, the value of 
bis 

the standard error of тъ, is approximately .103 as determined on 

our original abac. Machine computations, using eight place figures 


uracy. It should be noted 
aced in the abac to reduce the 
5 h ers Chart B. See general discus- 
sion on construction of abacs. 
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Abac 5 


T FROM 
АВАС FOR ESTIMATING THE POPULATION CORRELATION сетно 
THE COEFFICIENT OBTAINED FROM A CURTAILED SAMPL 

The abac for estimatin 
Navy population (X 
upon the formula: 


: rd 
g the correlation coefficient (R) ina puce 
= 10) from observed r in a curtailed sample is 


me 
ndard Navy population is always dd 
n using the abac, the preceding formu 
5 working formula: 


(Z, — 10). For convenience i 


Given the experimentally obtai 
enter the r, scale at the value .4 
across to the Ка scale and read 
value of the estimated Correlatio; 


ned values т, — 40 and о, = = 
0; run up to the radial line, а =8; 


off the scale value. In this case the 
n (Ra) is approximately .48. 
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Abac 6 


АВАС FOR ESTIMATING THE STANDARD ERROR OF A SUM OR DIFFERENCE 
This abac is based upon the formula: 


= = 3 
9,4577 9)» = Уб + 0, 


У : , Р t 
Data required for using this abac are the standard deviations of the tes 
score distributions (o, and о,). 


Given the experimentally obtained values o, = 14 and о, = 5, determine the id 
ordinate point on the abac which corresponds to these values. From the соога е 
point follow the circle to the diagonal and read off the scale value. In this case te 
answer is approximately 15. The use of good cross section paper in constructing 


abac, makes it possible to compute this function graphically for values from 0. 
1.000, or any similar range of values. 


| It should be noted that the use of this formula assumes a zero correla- 
tion between variables 1 and 2. 
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Abac 6. Abac for computing the stand 
difference, assuming that the correlation betv 
is low. 


ard error of a sum or 


veen the variables 
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Abac 7 
5 
АВАС FOR TESTING SIGNIFICANCE OF DIFFERENCE BETWEEN TWO PROPORTION 


The abac for testing the significance of a difference between two propor 
tions is based upon the formula: 
I „a — (Pi — P2)*/PQ 
Ина ee 
N,N, 
where average difficulty value, P — РМ, + Р.М, =1—P. 
8 y valu N,N, and Q 
Data required to use the abac are, for each of the two items, the number 
(N) attempting it and the proportion (р) of those attempting it who answer 
correctly. 


. H . 5 
For convenience in using the abac, the formula was transformed to " 
following: 


П. — р.) = (y? : l 
(а – рај = en (о) (3 +.) 
By formula II we determine ћ i с 
П w ow large the difference between P 
mun be to be significant at the desired level (in this case the 1% level): 
t пе been constructed to perform this calculation. 
0 llustrate the use of the abac, the following example is presente. 
ced 
na 


a 
№) and (р, М,). Connect these two points The 


values 


The 


|: 
Note that there аг 
values pı = 37, р, 
determines the coordinate points (p, 
read off the P value 


e “g” and then vertically into C^ the 


Е r 

mentally obtained difference is МЕ , the 
а i H H "n ad 
experimental difference is significant. Conve a: gg ee, i “sf 


a 
» jal Ji? 
Chart С опе could test PAK By drawing other sets of radial ie 8 
ii sangle at am i у ignificanc i 
position of the sets of radial lines is determi 4 x. s depen ot P" 
is selected). ined as a function of the value 


1For one degree of 2 
“gree of freedom, y? — 6.635 at the 1% level of significance. 


Pi -P 


iit ree ~] Зе 


300 


5 
500 00 400 
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LN 


400 300 200 100 0 100 200 300 400 500 


н н 
d Chart A ? 


for testing significance of differences between two 
proportions. 
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TABLE FOR ESTIMATING POPULATION CORRELA Dmm A 
EFFICIENT FROM CORRELATION COEFFICIENT OBTAL 
ON A RESTRICTED SAMPLE 


Kelley’s formula for estimating the correlation coefficient in an d 
restricted population from the correlation coefficient in a restricted sampe 
(from which abac 5, Appendix E-3, has been constructed) may also be P a 
sented in the form of a table. The accompanying table was actually m E 
from readings on such an abac and is therefore subject to an error 


d 
= .005. The column headings are values of £, the ratio of the standar 


P А А 1 - pu- 
deviation in the restricted sample to the standard deviation in the pot s 
lation. The row headings are the correlation coefficients obtained 1” 


restricted sample. The estimated correlation coefficient in the рормја е 
is found in the body of the table at the intersection of the approP ied. 
row and column. To save space, all decimal points have been omit te 
Given the experimentally obtained values of r= .40 in the restric he 
sample; c = 8.0, the standard deviation in the sample; 2 = Hs the 
standard deviation in the population; then the table is entered at at 
column headed 80 and the row headed 40. At the intersection 0 ient 
= red estimated correlation coeffic 


i i ee Р d in 
Discussion of the limitations in the use of this estimation is fou” 
Chapter XII. 


Observed Coefficient of Correlation 
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неба Blank, 23 
Appii ne Matching Test, 124 
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Committee on Selection and Training of 
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and Using Achievement 


Tests, 293 


Cornell Selectee Index, 131 
course grades, reliability, 


183, 188-189, 197 
Navy, evaluation, 377-379, 392- 


393 


criterion, acceptable characteristics, 358- 


362; improvement, 293, 296, 306-307, 
329.330; limitations, 138-141, 178, 222- 
. 268-272, 392-393; meaning of term, 
8: of personal adjustment, 138-140, 
174; of proficiency—nomination ratings, 
363, 386; of success in training, achieve- 


Pes ment test scores, 202-211, 220, 293, 296, 
a Ped Psychology Panel, 8 306-307. 329-330, 378; class rank, 219, 
“Ptitude tests (sce also tests, classification). 298; course grades: officer, 178, 180, 186- 
Ari) ded. research, 434 to 438 187. 191-193, 202, 206-210, 219-220, 327- 
Arica! Computation Test, 77-78 329, 376, 377; enlisted, 283, 236, 268- 
„пен са! Reasoning Test (see tests. 272, 305; pass-fail, 192, 196; problems 
Arithmetical Reasoning and Basic Test in development 362-376; supervisors’ 
Pes. Á ratings, 220, 378-379 (see also Officer- 
rao. College Qualifying Test (see Aptitude Rating); psychiatric, 138-140 
у curriculum analysis, 333 


5, College Qualifying) 


attituc S 
le studies (see information surveys) 


Basi 

Bitter es Battery (sce tests) 

Billet o dlerenee. Record, 135 

Billet Sepetifcations Blank (sec tests) — 

Diograph ection Requirements Manual, 16 
i? ^Phical information, research on use 
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232 p Neal-Preference Inventory, 227. 


Bureau of 
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Urean o dicine and Surgery, 128 
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Civilian Qucation (sce predictive measures) 
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contraen Ace Examination Board. 
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Digit Memory Span Test, 124 


Duty Recommendation Form, 16, 18. 217 


Enlisted Personal Inventory, (sce tests) 
enlisted personnel, classification, 


22-28; 


21-22; recommendation 
23, 234; records, 28-29; 


procurement, 
for assignment 
tests, (see also Chapters VI, VIIL, XU, 
XIII, XV, XVII, XVIII, XX), list, 459- 
164; training, advancement in rating, 45- 
16; operational, 45; recruit, 42-44; service 
schools advanced: description, 44-45, 
969.964. prediction of success, 262-284; 
elementary service schools: description 
44, prediction of success, 233-261; spe- 
cial programs, 46-49; WAVES, 47 
Enlisted Personnel Qualifications Card, 
99-93, 236. 252, 267, 384 
examinations (see tests) 
experience (see predictive measures) 
Experience Comparison Index (see tests) 
Fye-Hand Coordination Test, 128-124 


factor analyses, Basic Test Battery, 74-75 
failure in training and General Classifica- 
tion. Test Scores, 257-258 
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fleet schools (see operational training un- 
der enlisted "personnel and under officer 
personnel) А 

fleet validation (see shipboard perform- 
ance) 

forced-choice format, 130 


General Classification Test (see tests) 

General Mathematics Test (see tests) 

General Physics Test (see tests) 

grading systems, improvement, 292-294, 
296, 305-306, 327-329 

grading system, Navy, 318 


identification tests (see tests, achievement) 

indoctrination school, description of pro- 
gram, 35; prediction of success, 177, 180- 
186, 211-212 

Information Surveys, amphibious forces, 
421-429; off-duty education (educational 
services), 415-421; research methodology, 
429-432; training, 410-415 

interest measures, needed research on use 
in classification, 439-440 

interview (see predictive measures), en- 
listed, 22-23; needed research, 440-441; 
officer, 14-17; validity, 251-254, 260, 383, 
405 

interviewing officers, training, 15 

inventories (see personal adjustment meas- 
ures and biographical information) 


job requirements, needed research, 434. 
435 


Literacy Test, 78-80 
literacy training Program, tests, 78.8] 
Manual of Enliste 


tions, 26, 29 
Mechanical 4 
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National Defense Research Committee, 7, 
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Navy standard Score, 103 
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NDRC Project N-106 
search reports, 468. 
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Non-Verbal Classification Test, 80.81 
NROTC Selective Exa 
NROTC training (se 
training, college) 
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469; staff members, 
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Office of Scientific Research and Develop- 
ment, 7, 8 о 
Officer Aptitude Rating, 180, 182, 185, 192 
Officer Classification Battery, 107-108 
Officer Classification Test (see tests) 
Officer Personal Inventory (see и " 
officer personnel, classification proced sd 
14-19, 216-217; records, 19; prot 
12-14; tests, (see Chapters УП, се 
ХІ, XVI), list, 459, 461; training P 
grams; administration, 31, SUV о 
description, 37.88, 216-219, pu 
of success, 223-298, instructors, AO 
operational, description, 38-39, e 
Prediction of success, 228-230, prol 
Schools, (see also indoctrination sc esr 
Reserve Midshipmen's Schools, co de 
taining program, V-12 posui ed 
scription, 34-37; Regular Navy, 32 
training school reports, 217 
Officer Qualification Test (see tests) 1 
Officer Qualifications Questionnaire, 19, 
Officer Qualifications Record Jacket, 
217 А tests, 
Officers’ Selective Examination (see 
Officer Qualification Test) 
Operational fatigue, 126 T) 
opinion studies "sce Information Survey ) 
Ortho-Rater Tests, 24 
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personal adjustment, 126 viterion 
Personal adjustment measures, erate 
for validation, 138-140, 174; E 170- 
Of scores, 167-169; item format, 1o equres 
172; item difficulty, 171-172; pr design 
in development, 136-138; research es and 
for validation, 140-141, 173-174; vation? 
Misuses, 127-198; use in classifi rey 
9; validation studies, 141-169; У 
of item content, 169-170 
Personal Check List, (see tests) 1 adjust 
Personal inventories (see persona ical і 
ment measures and biographi 
formation al 2 
personality — (sce person? s 
justment measures) enlist 
prediction of success (see also rsonne”’ 
Personnel, training: officer p. iw 
training; shipboard perfor 00, o 
Provement, 184.186, 190, 199- à 
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235-236, 254, 260, 279-280, 
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civilian education, 227, 231, 235-236, 
254-256, 260-261, 280, 383, 399-400; civil- 
lan occupation, 227-232, 982.983, 383; 
effort, 404 ; interview, 251-954; lim- 
itation, 267-268; months of active duty, 
273, 279; naval experience, 383, 395- 
396; naval training, 280-282, 383, 400- 
104; Navy pay grade, 279, 383 

Pre-Radar Final Achievement Examina- 
tion, 390.329 

Pre-Radar General Aptitude Test (sce 
tests, Pre-Radar Officer Aplitude Test 
Battery) 

Pre-Radar Officer Aptitude Test Battery 
(sce tests) 

Previous Duty Check List, 135 

Proficiency tests, research on use in classi- 
fication, 438 

PSychiatric criterion, 138-140 

Psychiatric interview, 127 

Psychiatric screening tests (see personal 
adjustment measures) 


“Quality Classification” (see interview), 
понео, 235-236; validity, 251-254, 
6 


questionnaires (see Information Surveys 
and personal adjustment measures) 


"а ану Test—Speed of Response (sce 

ests 

Radio technician, selection, 331-332; train- 
116, 332; qualifications, 344-346 

r adio Technician Selection Test (see tests) 

ating, Navy (see advancement in rating) 


rati á ae 
ating scales, radio technician program, 
340-349 
тац H А H 
tings, supervisors (see criterion of suc- 


cess in training) 
cading Achievement Examination, 290 
aae Classification Examination, 290 
Rs ading Test (see tests) 
Cords, enlisted personnel, 28-29; officer 
З Personnel, 19 
Баш training (see enlisted personnel 
training) 
mierral Scores, 197 
тера е Movement Test, 107, 112-114 
med (see criterion, acceptable, and 
research, name of test or battery) e 
and „ " *thodology (see under criterion 
à Prediction of success), 136-141, 138- 
research 174, 429-432, 450-453 
eserye Уа ез, list, 465-469 
of Є Midshipmen's School, description 
= Program, 34 
е Midshipmen's School (Deck), pre- 
tOn of success, 177, 191-201, 212-213; 
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Standardized Examination, 319-320, 323. 
326 d 

Reserve Midshipmen's School (WR), (sce 
under waves officer training) 

restriction in range, correction, 237-238, 
506-507 


school grades (see course grades) 

Screening tests (see personal adjustment 
measures) 

Selectometer, 24 

self-idealizational scale, 133 

Sentences in Noise Test, 124-125 

Service Record, 28 

service schools (see enlisted personnel, 
training) 

sex differences in test scores, 90-91, 98-99 

shipboard performance, criterion, 384-393, 
405-406; nature, 380-381; predictive 
measures, 382-384, 393-409 

Social Judgments Test, 136 

Sonar Pitch Memory Test, 24, 123 

special aptitude tests, descriptions and 
uses, 112-125; needed research, 436-439 

Spelling Test (see tests) 

stop item, in measures of adjustment, 131 

suppressor variable, 133, 173 


tactical radar, (see CIC Aptitude Test and 
CIC Final Achievement Examination) 

Telephone Talker Test, 24 

Test and Research Section, history, 611; 
mission and accomplishment, 3-6; or- 
ganization, 4-5, 457; research studies, 
465-467; staff members, 457 

test item file, 351-353 

test item format (see descriptions of tests) 

test scores, sex differences, 90-91, 98-99 

tests: 
achievement (see also training); as crite- 
rion (see criterion); conversion of scores, 
485-187; enlisted personnel, 295-314, 
462-464; identification, 298-299, 301-303, 
476-481; list, 461-464; officer personnel, 
315-330, 461; performance, 297-298, 300- 
301, 340, 470-475; procedures used in 
development, 299-303, 316-318, 334-340; 
radio technician training, 331-340; types, 
288, 296-299, 318-320, 334-335; uses (see 
also criterion, achievement tests) 288, 
290-296, 320-350; value for predicting 
success in training, 337 
advancement in rating, cutting scores, 
353-354; development, 348-354; list, 460- 
461; scope, 347-348; 
Airplane Matching Test, 124 
Applicant Qualification Test, descrip- 
tion, 76-77; use, 22 
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tests—continued - 
aptitude (sce below under tests, classi- 
fication) - 
Arithmetical Computation Test, 77-78 
Arithmetical Reasoning Test (sce also 
test, Basic Test Battery), description, 57 
Army-Navy College Qualifying Test (sec 
below, College Qualifying Test) 
Basic Test Battery (including Arithmet- 
ical Reasoning Test, Clerical Aptitude 
Test, General Classification Test, Me- 
chanical Aptitude Test, Mechanical 
Knowledge Test, Radio Code Test— 
Speed of Response, Reading Test, Spell- 
ing Test), comparison of results at sta- 
tions, 66; cuting scores, 233; develop- 
ment, 54-55; development of norms, 65- 
66; description, 55-63; factor analyses, 
74-75; intercorrelations, 72-74; item 
analyses, 64; relation of scores to age, 
71-72; relation of scores to highest 
school grade completed, 71-72; reliabil- 
ity, 68-71; revision, 82-83, 435-436; time 
limit study, 64-65; time trends in scores, 
66, 68; uses, 22, 61-63; validity for classi- 
fication, service schools elementary, 75, 
236, 240-252, 258-260, service schools ад. 
уапсед, 267, 275.279; validity for ship- 
board performance, 383, 397-399 
Billet Preference Record, 135 
Billet Qualifications Blank, description, 
132-134; research studies, 153-162 
Biographical-Preference Inventory, 227, 
232 


C-r Test (see below, College Qualifying 
Test) 


CIC Aptitude Test, description, 119. 
115; validity, 115-116, 226-227 
CIC Final Achievem 
323, 327-329 


classification. tests, list, 459.461 
Clerical. Aptitude Test. (see also tests 


Basic Test Battery), description, 60-61 
College Qualifying Test, description 
108-109, 201-202; norms, 110; statistical 
analyses, 110; uses, 84, 11]; validit 
205-209, 213.914 " 
Cornell Selectee Index, 131 

Digit Memory Span Test, 194 
Enlisted Personal 1 
tion, 130-131; researc| 
166-167 


rent Examination, 


General Classification T 
tests, Basic Test p 
56; and failure int 


est 
attery 


raining, 957 


General Mathematics Test (sce also pre 
Radar Officer Aptitude Test Battery). 
validity, 223-296 

General Physics Test (see also d 
Radar Officer Aptitude Test аца 
validity, 223-226; in use prior to 194 
enlisted personnel), 6, 53 

Literacy Test, 78-80 wai 
Mechanical Aptitude Test (see alig em Д 
Basic Test Battery), description, VF 
Mechanical Comprehension Test, 12 та 
Mechanical Knowledge Test (sce es 
tests, Basic Test Battery), "3 
М Test, description, 191, 202; valic E, 
for prediction, 193-200; as a саго 
success in training, 202-211, 212-214 i 
Non-Verbal Classification Test, 80-8 
NROTC Selective Examination, 

200, 213 

Officer Classification Battery, um 
Officer Classification Test, age AES sels 
scores, 103; description, 101-102; E 
opment, 100-101; development of no aye 
103; revision, 106-107; statistical TE 
ses, 101; uses, 16, 84, 102-103; VERE dd 
104-106, 112, for primary training. 112. 
201, 213, for advanced training, | nil 
223-998, 250, 399.330, for operatio 
training, 228.23], 230.931 :ption: 
Officer Personal Inventory, descrip 

131; validity, 297, 232 +t) 
officer тиі (see officer person ot 
Officer Qualification Test, age an made 
Scores, 99; comparison of so de- 
by different groups, 90-91, 97-99: 
scription, 85-87; development, 


Statistical analyses, 88-92, 96; validity 
of items, 97; use, 12, 84, 87-88: Мате 
92-95, 180-186, 186-190, 193-200. a, E 
ersonal Check List, descriptio" 
135; research study, 163-167 
Personal Inventory, 129 
Personal Inventory, Form 
132 Еха 
Pre-Radar Final Achievement Р? с 
tion, 320-399 , rest б. 
Pre-Radar General Aptitude ^^, pa 
Pre-Radar Officer Aptitude pate 
tery) ‘est t 
Pre-Radar Officer Aptitude T Tes 
tery (see also General emt 
and General Physics Test), a 
Previous Duty Check List, 1 sp? 
Radio Code Test—Speed 
(see also Basic Test Battery 
description, 121-123 
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tests—continued 
Radio Technician Selection Test, 118- 
121 
Reading Achievement Examination, 290 
Reading Classification Examination, 290 
Reading Test (see tests; Basic Test Bat- 
tery), 56-57 
Relative Movement Test, 107, 112, 113, 
114 
reliability (sce name of test or battery) 
Reserve Midshipmen's Schools (Deck), 
Standardized Examination, 319-390. 
323.326 
Selection tests (see tests, classification) 
Sentences in Noise Test, 124-125 
Social Judgments Test, 136 
Sonar Pitch Memory Test, 24, 123 
Spelling Test (sce tests, Basic Test Bat- 
tery), description, 61 
Telephone Talker Test, 24 
Winchman and Hatchman 
Test, 128 

training (see also enlisted personnel and 
officer Personnel), evaluation, 309-311, 


Selection 
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323-326; failure and General Classifica- 
tion Test scores, 257; improvement, 
290-292, 296, 303-313, 322, 332-331, 339; 
needed research, 442-450 


validation (sec criterion; enlisted person- 
nel, training; officer personnel, training, 
prediction of success; predictive meas- 
ures; shipboard performance; and name 
of individual test or battery) 

V-12 training, prediction of success, 177, 
201.21], 213-214; description of pro- 
gram, 35-37 


waves, enlisted training, 47; officer pro- 
curement, 34; officer training. descrip- 
tion, 34, prediction of success, 186-190, 
212 

Women's Reserve (see WAVES) 

Winchman and Hatchman Selection Test, 
128 


Z-transformation technique, 393 


